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Chapter  l 


Introduction 


A  major  concern  in  reliability  is  minimizing  or  delaying  the  effect 
of  failures  of  critical  equipment.  Two  examples  of  this  concern  in 
practice  are  the  design  of  equipment  with  redundant  components  and  the 
scheduling  of  possibly  expensive  inspections  of  equipment  in  service. 
This  paper  will  concentrate  on  the  scheduled  maintenance  of  functioning 
equipment . 

The  general  optimal  maintenance  problem  involves  determining  a 
schedule  according  to  which  inspections,  repairs,  and  replacements  are 
made  which  optimizes  some  objective.  The  simplest  models  have  involved 
single  state,  single  component  systems,  a  failure  cost,  a  replacement 
cost,  no  inspections  or  repairs  and  a  long-run  cost  minimizing 
objective.  The  aim  was  to  try  to  replace  the  component  just  before  it 
failed,  balancing  the  cost  of  replacement  against  the  cost  of  failure. 
See  Barlow  and  Proschan  [1965]  for  some  discussion  of  these  simple 
models.  More  recent  optimal  maintenance  models  involve  multiple  states, 
multiple  components  and  intricate  cost  structures.  The  objective  is 
still  to  minimize  long-run  costs.  Sherit  and  Smith  ( 1 98 1 1  give  a  good 
review  of  the  optimal  maintenance  literature. 
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In  practice,  many  of  these  newer  models  suffer  from  two  problems. 
One  problem  is  that  normally,  many  costs  and  probabilities  need  to  be 
specified  in  order  to  use  the  model.  Even  worse,  in  many  cases  no 
reasonable  algorithm  is  given  for  determining  the  optimal  replacement 
schedule,  rather  it  is  only  determined  chat  this  optimal  policy  has  some 
property.  This  paper  deals  with  these  two  shortcomings  by  considering  a 
less  intricate  model  which  would  still  have  wide  application. 

Basic  Model:  A  system  consists  of  a  single  component  so  that  the 
system  fails  when  the  component  fails.  A  finite  number  of  spares  are 
available  for  the  component.  Replacements  are  made  in  zero  time  and  no 
costs  are  associated  with  failure  or  replacement.  Once  replaced,  a 
component  cannot  be  reused.  The  only  objective  in  the  Basic  Model  is  to 
maximize  the  expected  time  until  the  first  failure  of  an  installed 
component  by  setting  an  optimal  replacement  schedule.  The  time  until 
the  first  installed  component  failure  is  called  the  system  lifetime. 

In  designing  the  replacement  schedule,  one  attempts  to  balance  the 
possibility  and  expense  of  failure  against  a  limited  costly  supply  of 
spare  components.  The  best  application  would  be  a  system  with  a  single 
expensive,  vital  component  for  which  failure  is  catastrophic,  but 
replacement  is  possible.  For  example,  the  design  of  replacement 
schedules  for  heart  pace-makers  or  the  engine  of  a  single-engine 
airplane.  Another  application  would  be  in  a  hierarchical  approach  n 
system  reliability,  where  this  model  would  be  used  for  overall  system 
planning  and  more  detailed  models  would  be  used  for  developing 


replacement  schedules  for  specific  components  of  the  system.  Our  model 
Is  relatively  easy  to  use  In  practice  because  no  costs  need  to  be 
specified  and  the  optimal  replacement  policy  Is  easily  computable  under 
a  variety  of  assumptions. 

In  defining  the  Basic  Model,  we  have  not  discussed  how  to  model  the 
lifetimes  of  individual  spares.  Two  different  modelling  techniques  give 
rise  to  two  different  models.  These  two  models  are  then  combined  into  a 
third  model. 

Complete  Information  Model:  This  model  assumes  that  the  common 
lifetime  distribution  of  the  spares  is  known.  Further,  we  will  assume 
that  this  distribution  has  a  continuous  density  and  a  finite  mean.  This 
is  Che  most  difficult  model  to  apply,  since  we  are  assuming  more 
information  here  than  in  the  ocher  models;  but  it  also  gives  the  most 
accurate  results. 

Mlnimax  Model :  Rather  than  knowing  the  complete  lifetime 
distribution  of  the  spares,  we  only  know  that  each  lifetime  distribution 
has  certain  properties,  or  equivalently,  we  know  chat  each  distribution 
is  a  member  of  a  given  class  of  lifetime  distributions.  An  example, 
which  will  be  used  throughout  this  paper,  is  the  class  of  all  lifetime 
distributions  with  a  given  percentile.  Under  the  Minimax  Model,  Che 
objective  is  to  specify  a  schedule  which  maximizes  the  expected  system 
lifetime  under  the  worst  possible  lifetime  distributions.  These  spares 
will  be  known  as  miniraax  spares,  and  an  opcimal  schedule  will  be  known 
as  a  minimax  schedule. 
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Mixed  Model:  In  this  model,  the  spares  may  each  have  different 
properties.  Each  spare  may  have  a  completely  known  lifetime 
distribution  or  may  be  a  minimax  spare.  Among  the  spares  with  known 
lifetime  distributions,  each  may  have  a  different  distribution,  and  the 
miniraax  spares  may  have  different  properties.  The  interesting  aspect  of 
this  model  is  chat,  in  addition  to  specifying  che  schedule,  the  order  in 
which  the  spares  are  co  be  used  must  also  be  determined. 

Oerman  et  al.  [1984]  examined  che  Complete  Information  Model  and 
their  resulcs  are  presented  in  Chapter  2.  Their  focus  is  on  che 
Droperties  of  schedules  and  expected  lifetimes  for  spares  with  identical 
and  known  litecime  distributions.  The  primary  focus  of  this  thesis  will 
be  che  relaxation  of  che  assumptions  that  the  spare  lifetime 
distribution  is  known,  and  that  the  spares  are  identical;  i.e.  the 
Minimax  and  Mixed  Models.  In  Chapter  3,  the  minimax  replacement  time 
tor  a  single  spare  is  calculated  under  a  variety  of  distributional 
assumptions.  The  most  important  of  these  assumptions  is  that  the  mean 
and  variance  of  the  lifetime  are  known.  The  resulcs  obtained  in  Chapter 
3  are  then  employed  in  Chapter  4  to  derive  ninimax  schedules  and  their 
properties  for  multiple,  identical  spares.  The  Mixed  Model, 
specifically  che  problem  of  determining  the  sequence  in  which  different 
spares  should  be  used,  is  discussed  in  Chapter  5.  The  problem  is 
created  in  a  general  context,  for  which  sequencing  spares  is  a  special 
case.  Chapter  6  discusses  two  variations  of  the  Complete  Information 
Model.  In  che  first  case,  groups  of  spares  nav  be  used  in  parallel. 


This  means  that  a  group  of  spares  may  be  assembled  into  a  super-spare 
which  does  not  fail  until  each  spare  in  the  group  has  failed.  Two 
important  questions  are  what  size  groups  to  use  and  then  how  to  sequence 
these  groups.  In  the  second  case,  an  additional  spare  is  received  at 
some  time  in  the  future.  Chapter  7  summarizes  the  results  obtained  and 
suggests  some  directions  for  further  research. 


Chapter  2 


Complete  Information  Results 


Oerman,  Lieberman,  and  Ross  [1984]  are  the  only  authors  to  have 
considered  the  basic  model  of  this  paper.  They  treat  the  Complete 
Information  Model  described  in  Chapter  i.  Specifically,  n  spares  are 
available  for  a  single  component  system.  Replacements  are  scheduled  in 
an  attempt  to  maximize  the  expected  system  lifetime.  Replaced 
components  cannot  be  reused. 

Definitions  and  Assumptions 

Oerman  ec  al.  assume  the  lifetimes  of  the  spares  to  be  independent 
and  identically  distributed  with  a  known  distribution  function  F .  Let 
F(x)  =  l-F(x).  Further,  they  assume  chat  F  has  a  continuous 
density,  f,  concentrated  on  (0,T),  with  0  <  T  <_  ® ,  and 

T_ 

u  -  /  F(x)dx  <  =. 

0 

Let  r(x)  *  f(x)/F(x)  be  the  failure  rate  of  F. 

Now  we  will  be  more  precise  in  the  defintion  of  the  objective.  Let 
S  be  a  replacement  schedule,  and  L  the  time  before  the  first  failure 
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of  the  system  with  the  replacement  schedule  S.  The  objective  is  to 

choose  the  replacement  schedule  so  that  EL,  the  expected  failure  time 

under  the  replacement  schedule  S,  is  maximized.  Let  v^  be  the 

maximum  expected  lifetime  of  a  system  with  n  spares.  If  only  one 

spare  is  available  for  the  system,  then  there  is  only  one  schedule,  the 

one  that  never  replaces,  and  v^  *  u,  the  expected  lifetime  of  the 

spare.  For  n  >  1,  v  satisfies  the  recursion: 

n 

""  ’  “Wr  *»(t> 

where 

t 

0  (x)  -  /  xf ( x)dx  +  F( t) ( t+v  ,) 

n  0  n-1 

t_ 

3  /  F(x)dx  +  F(t)v  ,  . 

0  n*L 

Let  t  be  the  value  of  t  which  maximizes  5  (t)  above.  This 
n  n 

value  may  not  be  unique,  but  at  least  one  maximizing  value  does  exist. 

Thus,  t^  is  an  optimal  replacement  time  for  the  first  of  n  spares. 

If  t  *  0,  then  the  first  spare  is  not  used  and  v  *  v  ,  .  If  t  =  =  , 
n  r  n  n- 1  n 

then  only  the  first  spare  is  used  and  v  =  u.  The  collection  •  t  '* 

n  n  Kn<k 

is  called  an  optimal  schedule,  and  v^  is  called  the  value  of  the 
optimal  schedule,  or  the  optimal  expected  Lifetime. 

Derman  et  al.  prove  various  properties  of  optimal  schedules  and 
provide  examples  of  optimal  schedules  for  some  lifetime  distributions. 
These  results  will  be  summarized  shortly,  but  first  we  make  an 


observation  about  $  .  Notice  that  4  (t)  can  also  be  viewed  as  a 

n  n 

function  of  vn_p  which  will  henceforth  be  known  as  the  reward.  The 
reward  is  viewed  as  the  expected  lifetime  to  be  received  after  the 
successful  replacement  of  the  current  component.  In  general,  we  can  see 
chat  the  reward  for  successful  substitution  could  be  any  nonnegattve 
real  number,  say  v.  Then  we  can  define: 


The  special  definition  in  the  case  c  =  0  is  required  if  F ( 0 )  <  1, 

since  when  we  let  c  =  0,  we  mean  that  we  do  not  use  this  spare.  If  we 

Let  v  =  u,  and  for  n>l  let  v  =  h  (v  ,),t  =t„(v  ,)  we 
I  n  F  n- 1  n  F  n- 1 

recover  an  optimal  schedule  and  its  associated  optimal  return.  The 
function  h  will  be  known  as  the  single  spare  return  function,  since  i: 
cells  us  how  well  we  can  do  with  this  one  spare,  followed  by  an 
arbitrary  reward.  In  later  chapters,  h  will  have  different  subscriocs 
denoting  different  types  of  spares.  Thus,  for  example,  h^  denoces  tr.e 
return  function  for  a  single  spare  with  known  distribution  function  r. 
Similarly,  t^(v)  will  be  known  as  che  single  spare  replacement  time  ind 


will  have  different  subscripts  for  different  tvpes  of  spares. 


Results 


Now  we  turn  to  the  results  obtained  by  Derman  et  al.,  some  of  which 
are  recast  using  the  notation  introduced  above.  These  results  are 
presented  without  proof,  but  the  proofs  are  available  in  Derman  et  al. 
The  first  result  shows  us  when  n  spares  are  no  better  than  one  spare. 

Proposition  2.1:  v  =  v,  for  every  n  >  1  if  and  only  if 
- =- -  n  1  1 

T_ 

uF(t)  1  !  F(x)dx,  0  <  t  <  T  .  Z 

t 


This  condition  is  known  as  New  Worse  Than  Used  in  Expectation 
(NWUE).  All  results  which  follow  in  this  chapter  will  assume  that  F 
is  not  NWUE,  i.e.  v9  >  v^.  In  this  case,  it  follows  that: 


Proposition  2.2:  v  ,>v,v  „  -  v  ,<v  ,  -  v  ,  and 

- - -  n+L  n*  n+2  n+1  n+1  n* 


0  <  tn+l  <  tn  <  T,  n  =  1,  2,  3,  ...  . 


The  optimal  expected  lifetime  is  strictly  increasing  in  the  number 
of  spares,  but  its  first  difference  is  strictly  decreasing.  Further, 
any  optimal  schedule  increases  the  time  between  replacements  as  the 
number  of  spares  decreases. 

The  next  result  helps  in  determining  the  ootimal  schedule. 


and 


Proposition  2.3:  For  an  optimal  replacement  time, 
r  cannot  be  decreasing  at  t  .  I 

r* 


c  ,  r(  c  ) 

a  a 


If  F  has  a  strictly  increasing  failure  rate  (IFR),  then 

Proposition  2.3  determines  t  uniquely.  If  r  is  unimodal  and  has 

two  roots  to  r(t)  ■  1/v  ,  ,  then  t  is  the  smaller  of  the  two  roots. 

n- 1  n 

If  r  is  “bathtub  shaped,”  then  t  is  the  larger  of  the  two  roots. 

The  next  result  determines  when  the  optimal  lifetime  is  bounded  as 
the  number  of  spares  approaches  infinity. 

Proposition  2.4:  lim^^  v^  <  »  if  and  only  if  f ( 0 )  >  0.  I 

Although  t^  is  not  determined  uniquely  in  general,  t*  -  lim^^  t 
is  determined  uniquely.  The  following  proposition  gives  a  sufficient 
condition  for  t*  =  0. 

Proposition  2.5:  If  F(t+x)  <  F(t)F(x)  for  all  t,x  >  0  then 
t*  -  0.  : 

The  above  stated  condition  is  also  known  as  New  Better  Than  Used, 
Strictly  (NBU(S)).  This  is  a  weaker  condition  than  IFR  or  IFRA. 

Derman  et  al.  also  consider  optimal  periodic  schedules,  where 
replacements  occur  after  equal  amounts  of  time.  In  this  case,  a 
schedule  is  determined  by  one  number,  the  inter-replacement  time.  Two 
results  from  periodic  schedules  are  of  particular  interest  to  us  here. 
Let  yn  be  the  optimal  schedule  with  n  spares,  and  let  u^  be  the 
optimal  expected  system  lifetime. 

Proposition  2.6:  lim  v  ■  lim  u  ,  and 


Thus  periodic  and  nonperiodic  schedules  have  the  same  limiting 
properties,  both  in  expected  lifetime  and  in  the  actual  scheduling  of 
the  replacements. 

We  will  now  give  a  computational  example  from  Derman  et  al. 

Example  2.1:  Let  f(t)  =  2t,  0  _<  t  _<  1.  Then  F(t)  =  t^,  y  »  2/3 
2 

and  r(t)  =  2t/(l-t“).  Since  f(0)  =  0,  lim  v  =  ®.  Further,  since 

n-*®  n 

F  is  scrictlv  IFR,  it  follows  that  t*  *  0  and  the  equality 

r(t  )  =  l/v  ,  determines  t  uniquelv.  In  the  nocation  given  above, 
n  n- 1  n 


cF(v) 


and 


hF(v) 


Thus,  v  and  c  mav  be  calculated  recursivelv  according  to  the 
n  n  ' 

formulas,  v  ,  =  h_(v  )  and  t  *  c  (v  ),  with  Che  initial  condition 
n+l  F  n  n-t-1  F  n 

that  Vq  =>  0.  Some  actual  values  will  be  given  at  the  end  of  Chapter  4, 
along  with  similar  values  for  other  models.  □ 


This  concludes  the  exposition  of  the  results  of  Derman  et  al.  Sot 

that  no  general  closed  form  solution  for  the  v  and  t  is  given. 

n  n 

However,  if  F  is  of  one  of  the  types  described  above  (IFR,  unimodal, 
"bathtub  shaped"),  then  it  is  quite  easy  to  find  v^  and  t  •  A  more 
critical  problem  with  the  Complete  Information  Model  is  that  the 
lifetime  distribution  of  the  spares  must  be  known.  Since  it  is  our 


intent  chat  the  Basic  Model  be  easy  to  implement,  we  will  relax  tne 


Chapter  3 


Single  Spare  Minimax  Results 


In  the  previous  chapter,  we  explored  how  to  solve,  at  least  in 
principle,  the  problem:  max^  Lv(t,F).  Suppose,  however,  that  we  do  not 
know  the  actual  distribution,  F,  of  the  spare  lifetimes,  but  we  do  know 
that  F  lies  in  some  class  of  distribution  functions,  D.  Then  we 
define  h^(v)  31  3uPt  infp£Q  as  c^e  “inimax  solution  for  a 

single  spare,  or  the  miniraax  single  spare  return  function.  In  Chapter 
4,  the  full  Minimax  Model  will  be  considered,  with  multiple  spares. 

The  idea  of  the  minimax  approach  is  chat  we  cry  Co  do  the  best  that 
we  can  assuming  the  worst  outcome  of  the  information  which  we  do  not 
know.  This  approach  is  commonly  used  in  game  theory,  and  in  a  class  of 
optimal  inspection  problems.  Note  that,  assuming  the  supremum  and 
infimum  are  attained,  hQ(v)  *  ly(t*,F*)  <  Lv(t*,F°),  where  F°  is  any 
distribution  in  D.  Thus,  if  F°  is  the  actual  lifetime  distribution, 
then  Che  predicted  expected  lifetime  is  a  lower  bound  on  the  actual 
expected  lifetime,  given  we  use  the  schedule,  c* . 

Before  going  on  to  prove  the  main  single  spare,  minimax  results,  we 
will  define  the  class  of  functions,  d.  This  class  of  functions 
contains  all  single  spare  return  functions,  both  for  completely  known 
and  partially  known  lifetime  distributions. 


Definition  3.1:  h:lR  ♦  E  ,  is  a  member  of  H  provided: 

1.  h(x)  >  x,  x  >  0, 

2.  h(x)  <_  h(y),  y  >_  x  >_  0,  and 

3.  h(x)  -  x  h(y)  -  y,  y  >  x  >  0.  D 

Thus,  a  function  in  H  Lies  above  the  Line,  y=x,  is  nondecreasing, 

but  is  aiways  approaching  the  Line,  y=x.  Henceforth,  we  wiLL  use  the 
following  notations: 

u  =  h(0) , 

u  =  sup{ x  |  h(x)  *  u) ,  and 

v  =  inf { x  |  h(x)  =  x} . 

It  is  possibie  that  u  =  0  and/or  v  =  ®.  But,  [I  <_  u  <_  v  since 

h(x)  *  x  implies  that  x  _>  n .  but  h(x)  =  a  implies  that  x  £  u.  We 

will  now  give  one  example  of  the  usefulness  of  H.  Suppose,  v^  ■  u 

and  v  ,  *  h(v  )  for  h  e  H  and  n  *  1,  2,  3,  ...  .  Then  v  ,  >  v  , 

n+ 1  n  n-*- 1  —  n 

v  ,  -  v  <  v  -  v  for  n  *  2,  3,  i,  ...  and  Lim  v  «  v.  These 

n+l  n  —  n  n-1  n-»®  n 

first  two  results  are  just  the  first  two  results  of  Proposition  2.2, 
adjusted  to  allow  NWUE  distributions,  and  this  third  result  is  analogous 
to  Proposition  2.4,  and  will  be  proven  in  Chapter  4. 

Before  proving  that  all  single  spare  return  functions  belong  to  H, 
we  will  define  the  class  of  lifetime  distributions  from  which  all 
distributions  used  in  this  thesis  will  be  chosen. 

Definition  3.2:  C  =  •'distribution  fine  cions,  F  i  F(  J  )  =  3>.  I 


That  is,  C  is  the  class  of  all  lifetime  distribution  functions 


The  next  order  of  business  is  to  prove  that  the  single  spare  recurn 


functions  do  actually  belong  to  H. 

Theorem  3.1;  h^  and  belong  to  H  for  all  FeC  and  DcC. 

Proof :  First  we  will  consider  h  ,  taking  the  conditions  one  at  a 

time . 

1*  1^(0, F)  =  v  for  all  F,  so  h^(v)  2  v* 

2.  If  u  _>  v  then  L  (t,F)  2  Lv(t,F)  for  c  an<*  so 

hD(u)  2  hD( v) . 

3.  If  u  >  v  then  L  ( t ,F)-u  £  Ly( t ,F)-v  for  all  t  and  F,  so 
h0(u)-u  <  hD(v)-v. 

Now  if  we  let  D  *  {F},  then  we  can  see  that  h  ■  h  and  the 

F  D 

theorem  is  proved.  I 

We  will  now  coasider  the  case  of  distribution  functions  with  a 
known  percentile  as  a  simple  application  of  the  minimax  concept. 

Suppose  that  D  =  {FeC  |  F(s~)  *  P> •  That  is,  D  is  the  set  of  aLL 
lifetime  distributions  which  have  their  pCh  percentile  at  time  s. 
Then  the  minimax  return  function  is  quite  easy  to  compute. 


Proposition  3.1;  supc  lnfp^p  Lv(t,F)  =  hp  s(v),  where 

(  (s+v)(l-p),  0  <  v  <  s(l-p)/p, 

h_  „(v)  *  , 

P,S  (  v,  v  >  s(  l-p)/p. 


v  >  s(  l-o) /p. 


t  (v) 

P|S 


0  <  v  <  s  (  1  -  o  )  /  o  , 


v  >  s( l-o) /p. 


Proof :  No  matter  what  value  we  choose  for  t,  the  distribution,  F* 


minimizes  Lv(t,F),  where: 


jo,  c  <  o ' 

r*(t)  -  j  p,  0  <_  t  <  S, 

(  1, 


s  <  t  . 


Clearly,  there  is  no  advantage  in  choosing  t  strictly  between  0 
and  s.  Thus,  we  either  choose  u,  v  or  let  t  approach  s  from 


below.  A  simple  calculation  gives  the  stated  value  for  h  (v) 

p,s 


including  the  fact  that  c  (v)  -  0  when  v  >  s(l-p)/p.  C 

p ,  s  — 


Thus,  u  *  s(l-p),  u  =»  0,  and  v  =  s(  1  — p)/p  for 
Pts  P  >  s  P  »  S 


distributions  with  their  pch  percentile  at  s. 


Known  Mean  and  Variance 

The  most  interesting  rainimax  case  for  our  model  is  the  case  in 

which  we  know  the  mean,  u,  and  the  variance,  o  ,  of  the  spare  Lifetime. 

Let  C  „  be  the  set  of  all  lifetime  distributions  with  mean,  u,  and 
u  ,  O 

standard  deviation,  a.  More  precisely: 

*  00  -y  7  ? 

C  “  (FeC  I  ■  xdF(x)  =  u,  ,  x"dF(x)  *  a~  +•  u"  ^  . 

*'a  o  b 

Theorem  3.2:  sup  inf  L  (t,F)  *  h  (v)  =  max-'u.v,  sup  B(  t )  • 


and  c  (v)  - 

4  ,<j 


where  B(t) 


argsup  B(c) 

0<t<u 


,  h  (v) 

4, a 


,  h  (v) 

4, a 


>  raax(4  ,v } , 

=  4, 


c  + 


y(u-c)2 

?  9  * 

<3~  +  (U-C)“ 


This  theorem  gives  the  single  spare  return  function  for  a  spare 
with  known  mean  and  variance.  No  explicit  solution  for  sup^  B(t)  is 
given.  However,  it  turns  ouc  that  this  problem  is  quite  easy  to  solve 
It  will  be  seen  in  Theorem  3.3  that  any  one-dimensional  search  may  be 
used  to  solve  sup^  3(t).  Further,  the  maximizing  value  of  t  is  the 
optimal  replacement  time  for  this  spare  with  reward  v. 

The  proof  of  Theorem  3.2  will  reauire  three  lemmas  which  will  be 
described  briefly  here,  then  proven,  and  finally  combined  into  the 
complete  proof  of  the  theorem.  The  first  lemma  will  show  that  we  can 

3 

reduce  the  class  of  distributions,  C  ,  to  C  :  the  class  of 

4 ,0  4,0 

"chree-ooiat"  lifetime  distributions  with  known  mean  and  variance.  An 
n-point  distribution  is  a  discrete  distribution  with  n  points  of 
increase.  The  second  lemma  will  attack  the  problem: 

L  ( t ,  F ) .  Finally,  the  third  lemma  refines  the  result 

t€(-4,o  v 

of  Che  second  lemma,  to  reach  the  desired  result. 


Lemma  3.1:  inf..  „  L  (t,F)  =  inf  „  „3 
-  F*Cu,j  v  r  £  Cu  >  a 

Proof:  This  follows  from  a  result  due  to 


(c,F) 


Wass i lv 


Hoef  f ding 


f  1955  ] 


The  following  definitions  will  be  used  in  this  proof: 


Thus,  d(F,G)  is  a  norm  in  Che  space  of  discribucion  functions,  and 


C  is  Che  class  of  all  discrete  distributions  with  given  mean  and 

H  ,3 


variance. 


We  must  check  the  following  four  conditions: 


l.  There  must  exist  K  (x)  so  that  L  (t,F)  =  ,rK  (x)dF(x). 

t , v  v  t  ,v 


K.  (x)  = 

C,v 


j  X,  X  _<  C, 

(  C  +  V,  X  >  C. 


2.  ^  =  fFcC  |  Cgi(y)dF(x)  *  ci,  i  =  l,  2}. 

~>  2 

g^x)  *  x,  ct  -  a,  g2(x)  *  x",  c,  =*  a-  +  a  . 

3.  L  (t,F)  must  be  continuous  in  F  under  the  norm  d. 

v 

d(F,G)  <  5,  implies  that 

t 

!Lv(c,F)  -  Lv(e,G)|  <  l.f  (F(x)-G(  x)  )dx  +  v(  F(  t  )-G(  t ) )  | 

<_  (t  +  v)5. 

Thus,  Lv(t,F)  is  continuous  in  F. 

9 

4.  For  every  F«C  and  5  >  0,  there  must  exist  F*  s  C 
chat  d(F,F*)  <  5. 

Hoeffding  showed  that  this  condition  is  satisfied  in  the 
case  g . ( x )  *  x^ •  _ 

l  N 


Before  going  on  to  prove  Che  next  lemma,  we  will  pause  for  a  look 
at  the  properties  of  two-  and  three-point  distributions  with  given  mean 
and  variance.  These  results  are  all  given  in  Huang  [1983],  and  are 
restated  here  without  proof. 

Definition  3.3:  An  n-point  distribution  will  be  denoted  by 

(y^,  ...,  y  ),  the  n  points  of  increase.  The  orobabilitv  of  the  ith 

outcome ,  y . ,  is  p . .  G 
1  r  i 

3 

For  a  three-point  distribution,  (v,,v.,y_)  £  C  ,  the  p.'s  are 

‘  1  Lb  (1,0  L 

determined  as  follows.  This  follows  from  solving:  Ep.  =  1,  Ep  y  *  u. 


where 


and 


,  H(g  -  £j 
y  n  -  y 


2  ,  2 
P  +  g 


In  order  for  a  three-point  distribution  to  have  mean,  p  and 


2 

variance,  a  ,  the  y^'s  ®ust  satisfy  a  set  of  inequalities. 


3 

Proposition  3.2:  For  (y^^.yj)  £  g,  the  following 
inequalities  must  hold: 


0  <  yl  <  3y3  <  4  <  a  <  9yi  <  y3  < 
3y3  <  y2  <  3y^  * 


if  y2  <  p 

then  y^  < 

8V  ,  and 

if  y2  >  u 

then  y^  > 

3y  • 
y2 

In 

the  case  of  a 

two-point 

distribution , 

the 

situation  is 

simpler 

.  Given  (y  , 

y2}  £  c*  , 

P1  and  p2 

are 

given  by: 

y2  -  - 

2 

a 

-  - 

7l 

P1 

y2  -  yt 

a2  +  ( u 

v  2  *  p2 

"yl 

‘  71  ' 

In 

addition,  y 2 

“  3yt’  7i 

*  3V  ,  and 
*2 

0  <_  y^  <  j.  <  1  £  y^  <  =. 


We  now  have  the  necessary  information  on  two-  and  three-point 
distributions,  for  the  statement  and  proof  of  the  second  lemma. 
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Lemma  3.2:  inf„.„3  L  (tfF)  =  inf .,_A( y) ,  where 

“*  ~  ’  ~  r  €  w  V  Un/nu 


m  n  a  fv  +  t  -  v) 

A(y)  =  t  +  v - 5 - -r 

(p  -  y)“  +  a~ 


provided , 


v  /v  2 

a  -  c  £  2-/4  "  a 


Noce  that  (*)  requires  v  >_  2o. 

Proof :  Given  Chat  F  is  the  three-point  distribution  (y^,y2,y3): 


Lv(t,F)  = 


,  c  <  y  L , 

+  (L-p^Ht+v)  ,  y1  <_  t  <  y2, 
+  P2y,  +  P2(t+v),  _<  t  <  y3, 


y3  <_  t . 


Since  we  mav  choose  t  to  guarantee  h  (v)  =  max{p,vi,  we  are 

4  ,  o 

not  interested  in  how  much  inf  l  (t,F)  can  be  reduced  below  u  or 

F  v 

v.  Rather,  we  are  only  interested  in  values  of  t  which  ensure 

inf  L  (t,F)  >  max(u,v}.  There  are  four  cases  which  need  to  be 
r  v 

analyzed . 

Case  L:  t  <  y^ 

Since  t+v  _>  P^y^  +  ( 1  —  to  ^ )  ( t+v)  if  and  only  if  t+v  _>  v  ,  and  we 
can  never  guarantee  t  <  y^  with  our  choice  of  t,  case  1  is  dominated 
by  case  2.  That  is,  the  distribution,  F,  will  always  "choose"  v  <  z. 
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Case  2:  y  <  t  <  y. 


In  this  case,  Lv(t,F)  =  +  (1-pjHt+v)  =  t+v  -  p^t-v^v), 

recalling  that  p  is  a  function  of  y. ,  v, ,  and  v~ .  Since 

i  1  4  J 

3p^/3y7  >_  0  and  t+v  >_  y^,  it  follows  that  L/ ^ y 2  —  so  we  rauSC 

increase  y^  as  much  as  possible.  This  leads  to  y?  =  “y^ »  forcing 

d ^  =  0.  Thus,  we  drop  and  are  left  the  two-point  distribution 

2  2  7 

(y  ,v,)  with  y^  <_  t  <  v^ ,  and  p^  =  a  /(a  +(n-y^)“).  Substituting  p 
into  L^(t,F),  given  above,  yields  the  function  A(y^). 

Case  3:  y,  £  t  <  y^ 

In  this  case,  Lv(t,F)  =  p^y ^  +  p^y,  +  p3(t+v)  =  u  +  p3(t+v-y  ). 
Thus  we  niust  choose  t  to  ensure  that  c+v-y^  0.  The  only  upper 
bound  on  yn  applies  when  y,  <  a.,  so  we  must  choose  t  <  u.  In  this 
case,  y^  <  ?y  <  3^,  so  we  impose  the  condition  3 __  <  c+v  to  guarantee 
thac  inf  Lv(t,F)  _>  a  •  The  condition  3 ^  <  t*v  is  equivalent  to  (*). 
Assuming  (*)  holds,  it  is  easy  to  see  chat  <  0,  so  we  increase 

y  as  much  as  possible,  which  again  leaves  us  with  a  two-point 
distribution  as  y^  +  Q .  Since  the  two-point  distribution  is  (y,,y3), 


and  y~,  <_  c  <  y3>  the  situation  is  the  same 


as  an  case  2. 


Case  y3  <_  c 

It  cannot  be  the  case  chat  v3  <_  t,  since  we  have  already  seen  :ha 
we  must  choose  c  <_  u,  while  >'  >  u. 

Thus,  case  L  and  case  A  will  never  actually  happen,  and  cases  2  m 
3  give  the  same  value  for  ini„  Lv(c,r),  assuming  (*).  We  have  also 
seen  that  if  (*)  is  false,  then  inf_  L  it.?)  =  max'- .vx .  I 


Lemma  3.3:  (*)  implies  that: 


L  (t,F)  =  t  +  9v(u-~~  C) — T  =  A(t). 

o~  +  (n  -  t) 

Proof :  In  order  to  prove  this,  we  will  see  that  A'(y)  is  negative 
on  the  interval  [0,t].  Through  fairly  simple  algebra  it  can  be  seen 
chat : 


2 

a  . 

The  sign  of  A'(v)  depends  only  on  the  sign  of  its  numerator, 

-(ji-y)  -  2( v+t-u) ( ii-y)  +■  a~  =  a(v),  since  the  denominator  of  A'(y)  is 

nonnegative  for  all  feasible  values  of  y.  The  function  a(y)  is 

simply  a  parabola  in  (p-y)  with  maximum  at  v  =  v+t.  Thus,  a(y)  is 

decreasing  over  the  interval  [0,t]  =  (0,t+v).  All  that  remains  to  be 
seen  is  that  A'(t)  <  0,  which  would  imply  that  A'(y)  <  0  for  all  v 
in  the  interval  [ 0 ,  t ] .  In  order  to  determine  the  sign  of  A'(t),  we 
need  only  determine  the  sign  of  a(t). 

If  we  consider  a(t)  as  a  function  of  t,  it  can  be  shown  that  if 
t  satisfies  (*),  then  a(t)  <  0.  Since  a(t)  is  a  parabola  opening 
upwards,  if  a(c^)  <  0  and  a(t^)  <  0  then  a(t)  <  0  for  all 
t  £  [ t ^ , C ^ ] •  By  evaluating  a(t)  at  tne  endpoints  of  the  interval  in 

(*),  we  find  that  a(t)  <  0  when  (*)  holds.  Thus,  A ' ( y )  <  0  for 

y  c  [ 0 , t ] ,  so  A(v)  is  minimized  by  choosing  y  =  t.  I 


A'(y)  = 


2  2 
-(u-y)  ~  2( v-*-c-p)(u~y)  +  a 

,  ^  2 
(p-v)  +•  a 


We  are  now  in  a  position  to  give  a  complete  proof  of  Theorem  3.2 


Theorem  3.2:  sup  inf„  „  L  (t,F)  =  h  (v)  =  max(p,v,  sup  B(t)l, 
-  c  C|i  ,o  V  0<t<u 

,  h  (v)  =  v, 

u,a 

B( t)  ,  h  ( v)  >  max(u ,v} , 

U  ,0 

,  h  (v)  =  u, 

2 

where  B(t)  =  t  +  — - - -  . 

o'  +  (p-c)" 


and 


t  (v) 
u,o 


argsup 

0<t<p 


Proof :  By  choosing  c=0  or  t*®  ,  we  can  guarantee 

or  v,  respectively.  Lemmas  3.1  through  3.3  prove  chat 

raax(*i,v}  ,  then  h  (v)  =  sup  B(t)  as  stated.  □ 

-l  ,  o  c 


V.o(v)  =  u 


if  h  (v)  > 
p ,  o 


The  next  theorem  gives  some  details  of  the  solution  of  the  problem: 
sup^  B( c ) . 


Theorem  3.3:  dB(c)/dt  is  striccly  monotone  decreasing  on 
[0,p-o//3j.  If  B ' ( t * )  =  0  for  c*  c  (3,u-a// 3]  then  sup^  B(t)  = 
max{ B(0 ) , B(p) , B( t* ) ;  .  If  B'(t)  has  no  re  to  for  t  e  [0 , p-a//3],  then 
sup^  3(c)  =  max' B(0 ) , B(u ) }  . 


Proof : 


8 '  ( t)  =  1  - 


2vq~ ( u  -  c ) 


.  ■>  ■>  ,  ■» 

o'  +  (p-c)"  ~ 


ind 


o  ••  /  \  _ 


?  > 
2vq“ ( j” 


3U-c  )"  ) 


Thus,  B"(t)  <(>)  0  when  a *■  <(>)  3(u-cT 


A  relative  maximum,  if 


one  exists  must  occur  in  the  interval  [0,u-a//3],  because  that  is 
where  the  second  derivative  is  negative.  Since  B“(t)  is  negative  on 
(0fn-c//3),  B'(t)  must  be  strictly  monotone  on  this  interval.  I 

Bounds  and  Parameters 


Now  that  we  have  seen  how  to  compute  c^  Q  and  v^  we  will 

give  the  equations  for  u  ,  and  v 

u  ,a  u  ,a 

Theorem  3 . ^ :  If  u  >  2c  then  u  =  2a  and 


v 

U ,  C 


2  2 

ir  2f— 1  +  18  +  (2r  — 

27-  • a  a 


6)/l  -  3/r~)  1 

O' 


otherwise,  u  *  v  *  u. 

u  ,a  u  ,a 

Proof:  If  v  <  2a ,  then  (*)  cannot  hold  and  h  (v)  =  max{u.v'>. 

■-I  y  O 

Thus,  Uij  a  s  u  5  u’  since  for  v  <  u,  h  ^(v)  *  u,  and  for 

v  >  u. ,  h  (v)  =*  v.  The  fact  that  u  =2  a  follows  from  the  fact 

u  ,  J  u  ,c 

chat  (*)  requires  v  ^  2a ,  and  if  u  >  v  >  2c  then  we  can  guarantee 

h^  ?(v)  >  u  =  max{u,v}  by  choosing  c  =  -  -  a. 

To  get  v^  o,  we  find  the  largest  v  so  that,  for  some  c, 

v  =•  B(t).  Simple  algebra  shows  that 

v  <_  t  +  — — —  —  ■  -  if  and  onlv  if 

a"  +  (u-t)- 

2  3  2  2  2 

va  <c  -  2uc  +  (a  +u)c=g(c). 


By  solving  g'(t)  *  0  and  checking  Che  second  derivative,  we  can  see 


that  g(t)  is  maximized  at: 

e°  -  ^2  -  <l-34>1/2'  • 

Mow,  v^  ^  =  gCt0)7?^,  which,  after  a  significant  amount  of  algebra, 
yields  the  stated  result.  2 

This  proof  gives  the  following  useful  corollary. 

Corollarv  3.1:  t  (v  )  =  c°. 

- - -  u,a  u,c 

Proof:  t3  solves  the  equation  3(c)  =*  v  ,  for  v  »  v  ,  so 

-  U ,0  p.,0 

it  must  be  an  optimal  c  for  this  value  of  v.  2 


The  following  theorem  summarizes  some  bounds  on  t  which  are 

u  ,a 

useful,  both  theoretically  and  in  the  actual  computation  of  h  , 

U  ,  3 

since  the  bounds  reduce  the  size  of  the  interval  over  which  we  must 
search  for  the  optimal  t. 


Theorem  3.5:  If  v  s  (2  ,v  )  then 
-  u  ,  a  u ,o 


2 

^7  v  <  t  (v)  <  u  -  a,  t  (v)  > 
a 


v ,  and 


t  > 
a,o  - 


o 

t  . 


Proof :  Choose  (0,2)  as  a  two  poinc  distribution.  then  ?,  =  u.  n 
2  2  2 

=  u  /(p  f  a  )  and  L  (t,F)  *  ?  (t-t-v)  for  ail  the  reasonable  F's.  In 

'</  _ 

order  to  assure  p.,(C+v)  _>  e  ,  we  get  t  _>  z  -  v  (which  may  be 
negative).  The  inequality,  p  ( t+v)  >_  v,  guarantees  that  t  >  vj“/u~. 


To  see  chat  c 


a. 


<  Li  -  a,  we  firsc  notice  chat  c  (2a)  *  u  - 
n,a  —  ii,a 

This  may  be  checked  by  substituting  v  »  2a  and  t  *  p  -  c  into  the 

expression  for  B * ( t )  given  in  Theorem  3.3.  Then  we  use  the  fact,  to 

be  proven  in  the  next  chapter,  that  c  (v)  decreases  as  v 

,  a 

increases.  The  final  inequality  also  follows  from  this  fact,  along  with 
Corollary  3.1.  Z 

This  completes  the  single  spare  minimax  results.  The  most 
important  result  being  the  derivation  of  the  minimax  schedule  and 
expected  lifecime  for  distributions  with  known  mean  and  variance,  given 
in  Theorem  3.2.  This  and  the  other  results  will  be  the  basis  for  the 


following  chapters. 


Chapter  4 


Identical  Spares 


In  this  chapcer,  we  will  consider  the  problem  of  scheduling 
multiple,  identical  spares,  under  both  the  Minimax  and  Complete 
Information  Models.  The  focus  will  be  on  restating  the  results  of 
Derman  et  al.,  as  given  in  Chapter  2,  for  the  Minimax  Model.  This 
chapter  will  be  presented  in  three  parts.  The  first  will  consider  the 
case  of  a  finite  number  of  spares.  The  next  section  will  be  concerned 
with  the  calculation  of  limiting  values  as  the  number  of  spares 
approaches  infinity.  The  final  section  will  be  an  example  of 
computation  and  a  comparison  of  schedules  and  expected  lifetimes  under  a 
variety  of  assumptions  on  the  amount  of  information  known. 

Finite  Soares 

Before  considering  the  Minimax  Model  with  known  mean  and  variance, 

we  will  return  to  the  example  of  distributions  with  known  percentile. 

Once  again,  let  D  *  { Fc C  |  F(s  )  =  p}.  For  the  remainder  of  this 

thesis,  we  will  assume  0  <  p  <  1  and  0  <  s  <  The  values  for 

h  (v)  and  t  (v)  are  given  in  Chapter  3.  The  transition  from  a 
p ,  s  p  ,  s 

single  spare  return  function  to  an  optimal  schedule  for  multiple, 


Identical  spares  is  actually  an  easy  one.  Let  v.  =  0,  v  *  h  (v  ) 

0  n  p,s  n-1 

and  t  *  t  (v  , ),  n  *  l,  2,  3,  ...  .  Sow  v  is  the  minimax 
n  p,s  n-1  ’  n 

expected  lifetime  with  n  spares  available,  and  t  is  the  minimax 

replacement  time  of  the  nc^  spare.  As  might  be  expected,  v  and  t 

n 

nav  be  calculated  explicitly  in  the  case  of  a  known  percentile. 


Proposition  i.l:  Given  v  and  t  as  defined  above, 

- c -  n  n 

v^  =  s( l-( l-p)n)( L-p)  'p,  n  =  1,  2,  3,  ...,  and 


Cn  =  3  * 


n  =  1,  2,  3,  . 


Proof :  This  proof  will  be  by  induction.  Sote  that  v  *  s( l-p)  , 


and  assume  v^  =  s( l-( l-p)  )( L— p)/p.  Then 


/  /,  /,  ,n,(L-p)  .  •*  , .  ,  /,  /,  ,  n+L ,  (l-p) 

v  .  =  s(i-d-o)  ) — r—  *  s’(i-p)  =  sd-(i-p)  ) — -f-  . 

n+ l  p  r  p 


Since  v  <  s(L-p)/o,  t  ■  s  for  n  >  l.  I 
n-  L  n  — 


Proposition  1,2:  Given  v^  and  t^  as  defined  above, 


v  ,  >  v 
n+1  n 


v  —  v  <  v  -  v  ,  and  t  ,  =  t  ,  n  >  L  . 
n-*-2  n+l  nd  n  n+1  n  — 


°roof :  Using  the  facts  that  1  <  o  <  1,  and  0  <  s  <  ®  and 
substituting  the  values  from  Proposition  - . yields  the  desired 
results.  Z 


One  of  the  themes  of  this  secti;o  will  he  nonotonicity  results  for 

v  and  t  ,  not  onlv  as  n  varies,  out  as  the  parameters  defining  the 
n  n 

class  of  distributions  change.  Thus,  at  tds  tine,  we  are  interested  i 


and 


the  wav  v 


behave  as  p  and  s 


1  ^  J 


varied. 


Proposition  4.3:  is  increasing  in  s  and  decreasing  in  p, 

while  t  is  increasing  in  s,  but  is  unchanged  by  changes  in  p. 
n 

Proof:  That  v  and  t  are  increasing  in  s  is  obvious  from 
-  n  n 

Proposition  4.1.  It  is  also  clear  that  t  does  not  change  with  p. 

To  see  that  v  is  decreasing  in  p,  note  that  dv  /dp  <0  if  and  only 
n  n 

if  ( L-p)  n  >  (  I+np) .  But 

(l-p)  n  -  ( 1  +  p  +  p2  +  ...)n  >  1  +  np. 

Thus  the  final  assertion  is  proved.  L 

Now  that  we  have  seen  the  ease  with  which  a  known  percentile  may  be 

handled,  we  will  move  to  the  case  of  a  known  mean  and  variance.  Once 

again  we  define  v„  *  0,  v  ,  »  h  (v  ),  and  t  ,  *  t  (v  ),  n  >  0. 

°  0  n+1  a,a  n  ’  n+1  a,  a  n  — 

In  this  case  we  give  no  closed-form  expression  for  v^  in  terms  of  a 

and  o~ •  However,  as  was  shown  in  the  previous  chapter,  the  recursive 

calculation  of  the  v  's  and  t  's  is  not  hard.  Even  without  an 

n  n 

explicit  expression  for  v^  or  tn  we  may  still  recover  the 
interesting  raonotonicity  results  given  for  the  other  models. 

We  are  primarily  interested  in  how  v  and  t  vary  with  r“ , 

'  n  n 

and  n,  but  we  will  prove  slightly  more  general  results  in  the  next 
theorem. 

Theorem  4.1:  If  h  _(v)  >  max{u,v},  then, 

-l  f  J 

1.  t,  a  is  increasing  in  a, 

2.  a  -  t  is  constant  in 

a,  J 

3.  t  is  decreasing  in  v. 


4. 

t 

+  V 

is  increasing 

in  v, 

5. 

t 

u,cr 

is 

decreasing  in 

3, 

6. 

t 

+  0 

is  increasing 

in  0, 

7. 

h 

is 

increasing  in 

4,  and 

8. 

h 

4,0 

is 

decreasing  in 

0. 

Proof :  To  prove  Che  firsc  two  assertions,  note  that  4  and  t 

2 

only  appear  in  B'(t)  in  the  form  (4-t).  Thus,  if  v  and  0  are 
unchanged,  then  (4-t)  must  be  constant  to  insure  that  B'(t)  =  0. 

The  third  and  fourth  assertions  are  proved  as  follows.  The 
equation,  B'(t)  =  0,  is  equivalent  to  the  equation, 


v 


1  rs1  +  (4  -  t)2^2 
2c2(u  -  t) 


We  can  now  compute  dv/dt  and  see  that  dv/dt  <  -1  if  and  only  if 
4  U 

0  <  3(u-t)  ,  But  this  follows  from  t  £  4  -  0,  which  is  guaranteed  by 

Theorem  3.5.  This  proves  both  assertions. 

2 

The  next  assertion  to  prove  is  that  t  is  decreasing  in  0  .  The 
equation  B'(t)  ■  0  is  equivalent  to  the  equation, 

{ a 2  +  (u-t)2]2  =  2vo2(u-t). 


Considering  t  as  an  implicit  function  of  0  and  differentiating,  we 


Using  the  fact  that  p  -  t  >  c,  as  proven  in  Theorem  3.5,  and 
substituting  v  out  with  B'(t)  *  0,  it  can  be  seen  that  the  numerator 


of  this  fraction  is  positive  and  the  denominator  is  negative.  The  proof 
of  the  sixth  assertion  uses  the  same  equation  for  dt/do,  once  again 
substituting  out  for  v,  to  see  that  dt/do  >  -1. 

The  proofs  of  the  last  two  assertions  are  quite  easy.  Considering 
B(t)  as  a  function  of  a,  we  can  see  that,  for  fixed  t,  B(t) 
decreases  as  o  increases.  Thus,  it  must  be  that  supt  B(t)  also 
decreases  as  a  increases.  Similarly,  when  B(t)  is  considered  as  a 
function  of  p,  it  can  be  seen  that  for  fixed  t,  B(t)  increases  as 
u  increases.  ~ 

This  lemma  is  necessary  for  the  proof  of  the  next  theorem.  We 

already  know  that  0  <  dh  /dv  <  1  since  h  £  H.  Now  we  will  also 

—  u, a  —  p,  o 

see  that  h  is  convex. 

u,o 

Lemma  4.1:  dh  ^/dv  is  nondecreasing  in  v. 

Proof:  For  v  £  (p  ,v  ),  let  t(v)  be  the  minimax 
-  p,a’  p.a-’ 

replacement  time  considered  as  a  function  of  v.  Then  h  (v)  = 

a,  j 

B(t(v))  =  B(v,t(v)).  Now  dB/dv  =  5B/ *v  +  ( 5B/ 3t)(dt(v)/dv) ,  but  one 
condition  defining  t(v)  is  that  5B/5t,  evaluated  at  t(v),  is  equal 
to  0.  So,  dB/dv,  evaluated  at  t(v),  is  equal  to  5B/5v,  evaluated 
at  t(v).  That  is, 


But  this  is  increasing  in  v  since  t(v)  is  decreasing  in  v,  and  cr 

is  positive.  When  v  <  ?,  h'  (v)  =  0,  and  when  v  >  v, 

h'  (v)  =  1,  which  completes  the  proof  that  h'  is  nondecreasing 
,  a  ‘j.,  a 

in  v.  Z 

We  are  now  in  position  to  prove  the  monotonicity  results  for  the 

v  's  and  t  's.  These  results  will  be  contained  in  the  next  two 
n  n 

theorems,  the  first  of  which  deals  with  the  variation  of  n,  and  the 

2 

second  of  which  deals  with  the  variation  of  u  and  a  . 


Theorem  4.2: 

Given  v  and  t 

n  n 

as  defined 

above,  if 

V2 

>  vi 

then  v  ,  >  v  , 
n+l  n  ’ 

v  ,  -  v  ,  <  v 
n+2  n+l  n+l 

-  v  ,  and 
n 

t  <  t  , 

n+l  n 

a  > 

i. 

Proof:  Since 

h  c  H ,  we  know 

a, 3 

v  .  >  v  , 
n+l  —  n 

and  v  _ 
n+2 

-  V 

n+l  - 

v  ,  -  v  n  >  L .  All  that  remains  to  be  seen  is  that  the  inequalities 
n+ 1  n  — 

are  strict.  Suppose  v  ,  ■  v  >  v  Then  h  (v  )  *  v  and 

n+l  n  n-l  u,  a  n-l  n 

h  (v  +1)  =  v  ,  where  1  =  v  -v  ,  >  0.  Thus  by  the  Mean  Value 
a ,  3  n- 1  n  n  n-  L 

Theorem,  h’  (v)  =  0  for  some  v  e  [v  , ,v  ] .  But  this  contradicts 
u , O  n- L  n 

Lemma  4.1  since  v„  =  h  (v.)  >  v,  . 

2  1  1 

Similarly,  if  v  .  -  v  ,=v  ,  -  v  ,  then  h  (v  , )  - 
n+2  n+l  n+L  n  a, 3  n+l 

h  (v  )  =  v  ,  -  v  implies,  by  the  Mean  Value  Theorem,  that 
- ,  3  n  n+ 1  n  r  1 

h *  ^(v)  =*  1  for  some  v  s  ^Vn+i,Vn^’  ^uC  3  contradiction  since 

v  ,  <  v  and  h'  is  increasing, 
n+l  u.,3  a,  3  ® 

The  fact  that  t  ,  <  t  follows  from  the  facts  chat  v  >  v 

n+ 1  n  n  n- 1 

and  that  c  is  strictly  decreasing  in  v.  I 


This  theorem  is  the  same  statement  as  Proposition  2.2,  applied  to 
minimax  schedules  with  known  mean  and  variance.  Notice  that  the  proof 

uses  only  the  facts  that  h  „  £  H,  h  is  convex  and  that  t  is 

p. ,  3  u,  a  a,  a 

strictly  decreasing  in  v  for  v  £  ,v  ).  Thus,  parts  or  all 

>  O  u  y  O 

of  this  theorem  can  probably  be  proved  in  a  more  general  setting.  The 
next  theorem  gives  monotonicity  results  as  a  and  a  vary.  No 
analogous  result  exists  in  German  et  al . 

Theorem  4.3:  If  v„  >  v,  then  v  increases  with  u  and 
-  2  1  n 

decreases  with  3. 

Proof :  By  induction,  v^  =  a  which  is  increasing  in  u.  Assuming 

v  has  increased  with  the  increase  in  •  v  .  =  h  (v  )  must  also 
n  ’  n+1  p,  a  n 

increase  since  h  (v)  increases  with  v  and  a.  The  proof  for 
U  ,  "7 

changing  3  is  similar.  I 

Thus,  v  behaves  as  we  would  exoect.  When  the  soares  have  a 
n 

larger  mean  and/or  a  smaller  variance,  the  minimax  expected  lifetime  is 
Longer. 

The  situation  with  t  is  somewhat  comolicated  bv  the  fact  that, 

n 

since  t  »  t  (v  ),  t  is  affected  bv  the  change  in  „  or  r  as 
n  ,  3  n  n  5 

well  as  the  change  in  v  .  It  is  not  the  case  that  t  is  monotone  in 

n  n 

3,  as  we  can  see  from  the  following  counterexample. 

Consider  two  spares,  both  with  mean  equal  to  l.  If  the  first  spare 

has  a  variance  of  .1,  while  the  second  spare  has  a  variance  of  .2^,  then 

t.  is  larger  for  the  first  spare,  but  t  is  larger  for  the  second 

z  ■* 
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spare.  The  actual  numbers  are:  for  the  first  spare,  *  .55,  t,  =  . 

while  for  the  second  spare,  t^  *  *50  and  t^  a  .49.  The  question  of 

whether  t  is  monotone  in  n  is  still  open, 
n 

Once  the  optimal  or  minimax  schedule  has  been  computed,  it  is 
possible  to  calculate  the  cumulative  distribution  function  of  the  system 
lifetime,  Tg.  Let  F^  be  the  distribution  of  the  ith  spare  and  t^ 
the  replacement  time  with  i  spares  remaining.  A  total  of  n  spares 
are  available  and  we  assume  t^  ■  «.  Define  k(t)  £  {l,...,n}  so  that: 

n  n 

l  t .  £  t  <  ^  t . ,  o  <  t  <  -. 

i-k(t)+l  i=k( t ) 

n  _  n 

Then  P{T  >  t}  =  {  H  ?  ( t. ) ;  (F.  .  . ' t-  \  t  ) } ,  0  <  t  < 

i-k(t)+l  i-k(t)  +  l 

We  use  the  convention  that  if  the  lower  limit  of  a  sum  (product)  is 
smaller  than  the  upper  limit  then  the  sum  (product)  is  0  (1).  The  first 
term  in  the  product  is  the  probability  of  successful  replacements  and 
the  second  term  is  the  probability  of  the  newest  spare  surviving  long 
enough  to  bring  the  total  system  lifetime  up  to  t. 

In  the  Complete  Information  Model,  the  lifetime  distributions  are 
identical  so  F^  *  F  for  i  ■  1,  ...,  n.  For  distributions  with  a 
known  percentile,  all  of  the  minimizing  distributions  are  also 
identical,  as  given  in  Chapter  3.  In  the  case  of  distributions  with 

known  mean  and  variance,  three  cases  must  be  considered.  If  0  <  t .  <  - 

r 

the  minimizing  distribution  is  the  two-point  distribution  with  y  =  t, 


and  c^e  case,  t^  ■  0,  can  be  any  distribution  for 

which  F^CO)  •  0.  In  the  case,  t^  -  n,  we  set  t  *  ®  and  any 
distribution  in  g  works  as  a  minimizing  distribution  for  this  case, 
so  one  can  be  chosen  arbitrarily  for  computing  p{T  >  t}. 

Limiting  Results 

As  the  number  of  spares  goes  to  infinity  we  will  be  primarily 
concerned  with  relating  periodic  schedules  to  general  schedules.  Before 
presenting  the  actual  results,  we  will  give  the  definition  of  the 
minimax  periodic  expected  lifetime  and  schedule  for  multiple  identical 
spares.  The  first  step  is  to  provide  an  analog  of  L^Ct.F). 

Definition  4.1:  Ln(t,F)  =  the  expected  lifetime  with  n  spares 
using  the  periodic  schedule  t,  under  the  lifetime  distribution  F. 

That  is,  Ll(t,F)  -  LQ(t,F),  Ln+l(t,F)  -  L^n( ^  p)(t,F),  n  >  1.  Q 

Definition  4.2:  Let  Y^Cn)  *  sup^  inf^,^  Ln(t,F) 

and  ^D(n)  ■  argsup^  inf  Ln(t,F).  j 

Thus,  Y^(n)  is  c^e  minimax  periodic  expected  lifetime  and  -  (n) 
is  the  minimax  periodic  replacement  time,  both  for  n  spares,  for 
spares  with  distributions  from  the  class,  D  c  C. 

It  is  quite  easy  to  compute  Ln(t,F). 
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t  n-L_ . 

Ln(c,F)  -  (f  F(x)dx)  l  FJ(t)  . 
0  J-0 


Proof :  This  is  evident  from  backsubstituting  into  the  equations 
given  in  the  definition  of  Ln(c,F).  Q 


Prooosition  4.2: 


L°°  ( t ,  F )  =  Lim  La(t,F) 

n*® 


t_ 

/  F(x)dx, 
0 


F(t)  >  0, 
F(t)  =  0. 


Proof :  This  is  evident  from  Proposition  4.1. 


Derman  et  al.  prove  two  limiting  results,  given  in  Propositions  2.4 


and  2.6.  The  analogous  results  for  the  Minimax  Model  are:  lim  v 

J  -*03  ^ 


v,  lim  v 
n-*®  n 


lira  ^  Y_.(n)  and  lim  t 
n-*®  D  n-*®  n 


lim 


Tq( n) .  The 


first  result  can  be  proven  for  all  classes  of  distributions  D  =  C. 


Theorem  4.4:  Given  h  e  H,  define  v,  =  0,  v  =  h(v  ),  for 
-  0  n+l  n 

n  -  1,  2,  3,  ...  .  Then  lim  _  v  =  v. 

n-*®  n 

Proof:  Let  v  -  lim  _  v  ,  which  exists  since  v  is  an  increasing 

-  n-*®  n  n 

sequence.  Suppose  v  <  v.  Then  h(v)  >  v.  Let  A  ■  (h(v)-v)/2.  Then 

h(v-A)  >  v,  since  h(v)  -  h(v-A)  <_  A  bv  condition  3  of  the  definition 

of  H.  3ut  there  exists  an  n  so  that  v  >  j  -  A,  which  imolies  toac 

n 

v  ,  >  v  which  is  a  contradiction. 

n+L 


I 


i 
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Now  suppose  that  v  >  v.  Then  there  exists  an  n  so  that  v  <  v 

n  — 

and  h(v  )  >  v.  But  this  is  impossible  since  for  v  «  (v  +  v)/2, 
n  n+ l 

h(v)  »  v,  but  v  >  v  and  h(v  )  »  v  .  >  v  ■  h(v),  which  contradicts 

n  n  n+l 

the  raonotonicity  of  h.  □ 

The  formulas  for  v  and  v  have  been  given  in  Chapter 

p,s  u,o 

3.  When  D  is  a  single  distribution  function,  v  -  lim  v  can  be 

n-*®  n 

finite  or  infinite  as  stated  in  Proposition  2.4. 

Our  analog  of  Proposition  2.6  must  be  proved  on  a  case  by  case 
basis.  As  usual,  we  will  begin  with  the  class  of  distributions 
determined  by  a  known  percentile.  Let  D  =  {FeC  |  F(s  )  **  p}.  As  might 
be  expected,  everything  is  easy  in  this  case. 


Proposition  4.4:  Given  D  as  defined  above, 


Y_(n)  *  v  and  x  (n) 
D  n  0 


t^ ,  n*l,  2,  3,  ...  , 


for  and  t^  as  given  in  Proposition  4.1. 


Proof :  The  minimax  schedule  given  in  Proposition  4.1  is  actually  a 


periodic  schedule,  since  t  does  not  depend  on  n.  - 

n 


From  this,  it  is  trivially  true  that  lim  v  *  lim  y_(n) 

n-*®  n  n-**>  D 


and  lim  t  =*  lim  t  (n). 
n-*®  n  n-*®  D 


We  now  return  to  the  case  of  known  mean  and  variance.  In  this 


case,  the  computation  of  anc*  is  difficult.  This  is 


because  Hoeffding's  result,  as  used  in  Lemma  3.1,  cannot  be  applied 


here,  since  there  is  no  function  K.  (x)  which  satisfies  condition 

:  ,v 


given  in  Lemma  3.1.  Thus  we  cannot  resort  to  three-point  distributions 


in  order  to  solve  this  problem  for  a  finite  n.  However,  in  the  limit, 
we  can  use  three-point  distribution  results. 


Theorem  4.5:  lim  y  (n)  -  v 
-  n-*”»  u ,  o 

This  theorem  not  only  gives  the  minimax  periodic  schedule  lifetime, 
but  states  that  it  is  the  same  as  the  limiting  lifetime  for  nonperiodic 
schedules.  So,  once  again,  we  obtain  the  result  that,  in  the  limit,  it 
is  no  worse  to  use  a  periodic  schedule.  In  order  to  prove  this  theorem, 
we  will  need  two  lemmas,  which  are  now  given.  These  will  calculate  the 
limiting  values  for  periodic  schedules  under  different  assumptions.  We 
will  then  show  that  the  value  of  interest  is  bounded  by  these  two 
values. 


Lemma  4.2:  lim _ sup^  infp.,,3  Ln(t,F)  ■  v 

-  n-*“  t  FcCu>a  (i,0 

Proof :  We  will  first  see  that  the  limit  may  be  pulled  past  the 

supremum  and  infimura.  Since  inf  3  LU(t,F)  is  increasing  in  n 

t€Lu,  0 

for  any  t  ^  0,  the  limit  and  supremum  may  be  exchanged.  The 


interchange  of  the  limit  and  infimura  can  be  justified  by  noting  that, 
for  fixed  t,  Ln(t,F)  converges  to  L^Ct.F)  uniformly  in  F,  provided 


we  add  the  restriction  that  F(t)  >  t  which  can  be  done  without  loss  of 


generality  for  small  enough  t.  Thus  we  are  left  with  the  problem: 


Supt  infFgCi(J  L’(t’F) 

If  we  let  F  be  the  three-point  distribution  (y^,y?,y^),  then 
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i(y LPL  +  yl  <  t  <  y2 

< y i p i  +  y2P2  +  p3c>/(p1+p2) »  y2  1  c  <  y3 

H.  y3  -  C 


As  in  Lemma  3.2,  four  cases  muse  be  analyzed. 

Case  1:  t  <  y^ 

As  in  Lemma  3.2,  Che  distribution,  F,  will  always  "choose"  y^  <_  t 
to  avoid  the  high  expecced  lifetime  afforded  by  case  1. 

Case  2:  y^  £  c  <  y2 

In  this  case,  L  (t,F)  =  (y^-t)  +  t/p^.  Thus,  5L/5p^  0  and 

3p^/5y2  >  0,  so  3L/3y2  0  and  we  must  increase  y 2  as  much  as 

possible.  This  leaves  us  the  two-point  distribution  (y^y^  with 

2  2  2  ®  2  2 
yL  <  t  <  y2  and  p^  =  a  /{a  +(p-y1)  ).  Thus  L  (t,F)  =  y^tCp-y^  !a 

for  this  case. 

Case  3:  y9  <_  t  <  y^ 

CO 

Now  L  (c,F)  ■  ((t-yj)?^  +  dVCl-p^).  In  order  to  ensure 

CO 

L  (t,F)  >  |i,  we  need  p  +  t  -  y^  _>  0  which  is  true  if  and  only  if 


'  2 

a_  _ 

4 


(*') 


As  in  Lemma  3.2,  SL/Sy^  <0  so  we  increase  y^  as  much  as 
possible,  forcing  y^  -*•  0  and  leaving  the  two  point  distribution 


(y-.»yj 


Since  y.  <  t  <  y. ,  we  are  in  the  same  situation  as  case  2. 


Case  4:  y^  <  t 

This  case  can  never  apply  since  we  have  already  seen  chat  t  <_  p 
is  forced  by  (*')  and  y^  >  p. 

2  2  2  2 

We  now  see  that  inf  .  {y  +  t(p-y)  /a  }  -  t  +  t(  p-t)  la  .  Notice 

y<t 

2 

that  d/dy  *  1  -  2t(p-y)/a  is  negative  when  (**)  holds.  Since  we  have 

the  constraint,  y  <_  t,  the  infimum  is  attained  at  y  =  t.  Thus, 

inf  3  L°°(t,F)  *  t(  o'  +  (p-t)^)/o^  when  (*')  holds. 

f€Cp,  a 

Now  that  all  the  cases  have  been  considered,  we  need  only  one  more 

2  2  2 

step.  Notice  that  supt  t(a  +  (p-t)  )/a  is  the  same  problem  we 
solved  to  find  v  in  Theorem  3.4.  Thus, 

SUpt  lntFecJ,a  L"(t>F)  ’  %,„•  3 

Before  proving  the  next  lemma  we  need  to  make  one  definition  which 

will  be  used  in  the  lemmas  to  follow.  Let  u^(t)  -  0,  u^+^(t)  “ 

inf_,_  L  /_\(t,F),  and  u  «  sup^  u  (t).  Thus  u  is  the 

rtLp.u  un(.t;  n  t  n  n 

miniraax  expected  lifetime  for  a  slightly  different  interpretation  of  a 
periodic  schedule.  It  is  not  required  chat  the  spares  have  the  same 
distribution,  only  that  all  of  the  distributions  have  the  same  mean  and 
variance. 

Lemma  4.3:  lim  u  =■  v 
-  n  p,a 

Proof:  Since  u  ^.(t)  >  u  (t)  for  n  >  1,  t  >  0,  it  follows  that 
—  ■  ■  ’■  n+ 1  —  n  —  — 

lim  sup  u  (t)  *  sup  lim  u  (t).  Thus,  lim  u  ■  sup  lim  u  (t). 

n  rt  n  rt  n  n  n*®  n  rt  n-**>  n 

If  we  choose  a  t  such  chat  inf,,-  L  (t,F)  >  p  then  u  .,(t)  >  u  (t) 

r  £  o  ^  ^  q  li  n+ 1  n. 

for  all  n,  so,  for  such  a  t, 
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The  first  and  last  equalities  are  proved  in  Lemmas  4.2  and  4.3.  The 

inner  inequalities  are  actually  true  for  every  n,  not  just  in  the 

3 

limit.  The  left-hand  inequality  is  easy  to  see.  Since  C  c  c  , 

4,3  4,3 

inf_  -3  Ln(t,F)  >  inf  Ln(t,F). 

teu4,3  ~  F€Cm-i<7 


Now  we  take  supremums  on  both  sides  and  the  right-hand  side  becomes 


The  fact  that  y  (n)  >  u  follows  from  the  fact  that  each  of 
4,3  ~  n 

the  n  spares  represented  by  u^  may  have  a  different  distribution, 
while  all  n  spares  must  have  the  same  distribution  in  y  (n). 
Thus,  the  minimization  of  u^  is  done  over  a  larger  space.  C 
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Since  the  same  limiting  optimal  replacement  time  results  in  Lemmas 
4.2  and  4.3,  it  is  strongly  suggested  that  this  should  be  the  limiting 


value  of  t  (n)  as  n  -*•  ®.  But  no  proof  of  this  proposition  is  given. 

M- ,  n 

Further,  this  limiting  replacement  time  in  Lemmas  4.2  and  4.3  is  equal 


to  lim  t  . 
n*®  n 


Computational  Example 

Now  that  we  have  successfully  treated  the  finite  and  infinite  case 

of  multiple  spares,  we  will  give  a  numerical  example  comparing  all 

models  discussed  so  far.  We  will  give  v  and  t  for  selected  values 

6  n  n 

of  n  for  three  different  spares. 

Example  4.1:  The  first  of  the  three  spares  is  the  one  used  in  the 
example  in  Chapter  2.  It  has  a  known  distribution  with  density, 
f(t)  =  2t,  0  <_  t  <_  I .  The  second  spare  has  known  mean  and  variance 
which  correspond  to  the  mean  and  variance  of  the  first  spare.  The 
second  spare  has  an  expected  lifetime  of  2/3  with  variance  1/18.  The 
final  spare  has  a  known  percentile,  corresponding  to  the  first  quartile 
of  the  distribution  of  the  first  spare. 

The  information  assumed  about  each  of  the  spares  is  presented  in 
Table  4.1  and  the  schedules  and  lifetimes  are  given  in  Table  4.2.  For 
the  minimax  spares,  the  predicted  lifetime  (based  on  the  information 
assumed)  is  given  in  the  column  labeled  v  .  The  expected  lifetime 
which  would  be  realized  if  the  actual  lifetime  distribution  is  that 
of  spare  l  is  given  in  the  column  labeled  r^.  □ 
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Spare  # 


S 


Information 


1 

complete 

information 

f(t) 

=  2t,  0<t<l 

2 

minimax, 

known  mean  and  variance  |i  = 

2/3,  a 2  =  1/18 

3 

minimax, 

known  percentile 

s  = 

1/2,  p  =  1/4 

Table  4.1  Spare 

Definitions 

Spare  1  Spare  2  Spare  3 


n 

V 

t 

V 

r 

t 

V 

r 

t 

n 

n 

n 

n 

n 

n 

n 

a 

1 

0.67 

1.00 

0.67 

0.67 

00 

0.38 

0.67 

ao 

2 

0.96 

0.54 

0.78 

0.92 

0.36 

0.66 

0.96 

0.50 

3 

1.19 

0.43 

0.85 

1.14 

0.33 

0.87 

1.18 

0.50 

4 

1.38 

0.37 

0.90 

1.33 

0.31 

1.03 

1.34 

0.50 

5 

1.55 

0.33 

0.94 

1.50 

0.30 

1.14 

1.46 

0.50 

10 

2.20 

0.23 

1.01 

2.17 

0.27 

1.42 

1.75 

0.50 

20 

3.14 

0.16 

1.03 

2.94 

0.27 

1.50 

1.83 

0.50 

40 

4.45 

0.LI 

1.03 

3.48 

0.27 

1.50 

1.83 

0.50 

Table  4.2  Optimal  Schedules  and  Expected  Lifetimes 

Notice  that  the  first  spare  has  the  longest  expected  lifetime  for 
every  n.  This  is  because  it  has  the  best  information  available  on  the 
actual  distribution  of  the  spare  lifetimes.  The  schedule  generated  by 
spare  2  gives  the  next  largest  realized  expected  lifetime  for  n  5 
even  though  it  predicts  a  smaller  expected  lifetime  than  the  third  spare 
for  n  >  3.  Also  note  that  the  realized  expected  lifetimes  for  the 


mintmax  spares  are  quite  a  bit  larger  than  the  predicted  expected 
lifetimes.  This  is  because  the  minimax  approach  is  conservative. 


Chapter  5 


Different  Spares 


In  the  previous  chapter,  we  treated  the  case  of  multiple,  identical 
spares.  Since  the  spares  were  identical,  we  did  not  have  to  concern 
ourselves  with  the  problem  of  deciding  the  order  in  which  the  spares 
should  be  used.  In  this  chapter,  we  will  allow  the  spares  to  be 
different  from  each  other  and  consider  the  sequencing  problem. 

Since  we  are  now  capable  of  computing  h^(v)  for  a  variety  of 
classes,  D,  we  could  always  check  all  of  the  n!  possible  orderings; 
computing  the  expected  lifetime  of  each  and  simply  choosing  the  sequence 
which  provides  the  largest  expected  lifetime.  However,  since  n!  grows 
so  quickly,  this  would  limit  us  to  solving  problems  with  only  a  small 
number  of  spares.  Two  improvements  on  this  total  enumeration  scheme 
are  the  topic  of  this  chapter. 

The  first  improvement  is  based  upon  a  sufficient  condition  for  an 
optimal  sequence  to  exist  in  which  a  particular  spare  precedes  another 
spare.  Before  discussing  this  in  more  detail,  a  formal  definition  of 
the  optimal  sequencing  problem  is  given. 


Definitions 


Definition  5.1:  Given  a  set  of  functions,  h,  ,  h_  ,  . . . ,  h  e  H  and 
-  12  n 

a  permutation,  it,  of  {1,2 . n},  let 

P(u,v)  =  h  (h  (  ...  h  (v)  ...  )). 
nl  n2  n 

The  optimal  sequencing  problem  is 

max  P(u,v).  G 
it 

Notice  that  we  have  defined  the  optimal  sequencing  problem  without 

any  reference  to  actual  spares.  This  is  because  the  spares  are  now 

represented  by  their  single  spare  return  functions.  For  example,  if  the 

third  spare  in  our  list  had  a  known  lifetime  distribution  function,  F, 

then  we  would  have  h_(v)  *  h  (v).  Further,  P(it,v)  is  the  expected 

J  F 

lifetime  with  the  permutation  x  and  reward  v. 

The  sequencing  problem  is  defined  for  functions  which  belong  to  H, 
but  this  is  done  only  for  simplicity.  This  problem  could  just  as  easily 
be  defined  for  arbitrary  functions.  However,  all  of  our  single  spare 
return  functions  do  belong  to  H,  and  later  in  this  chapter,  it  will  be 
important  to  restrict  ourselves  to  the  class  H. 

As  noted  previously,  only  n!  distinct  permutations,  x,  exist,  so 
the  optimal  sequencing  problem  may  be  solved  by  computing  P(  ix,v)  for 
every  x  and  choosing  the  permutation  yielding  the  largest  value. 

While  our  algorithm  will  be  based  on  this  idea,  two  ways  of  reducing  the 
number  of  permutations  to  be  checked  is  discussed. 

Before  describing  an  improved  algorithm,  some  additional 
definitions  are  provided. 


Definition  5.2:  If  it  (1)  <  it  (j)  then  we  sav  "i  precedes  j  in 


it, “  or  "h^  precedes  in  t."  C 

For  example,  for  n  =  3,  if  =  2,  =  3,  and  =  1,  then 

P(it,v)  =  h?(h  (h^(v)))  and  2  precedes  3  which  precedes  l.  This 
corresponds  to  using  spare  2  first  and  spare  1  last,  after  which  we 
receive  v  if  all  replacements  have  been  made  successfully. 

Definition  5.3:  Given  g,h  £  H,  if 

1.  g(v)  h(v)  for  all  v  >_  0,  and 

2.  g(v)  -  g(u)  >_  h(v)  -  h(u)  for  all  v  >  u  ^  0  such  that 

h(v)  >  v,  then  we  say  "g  is  better  than  h"  or  g  »  h.  C 

Note  that  if  g  =  h,  then  g  >  h  and  h  »  g.  A  function  g  is 

"strictly  better"  than  h  if  g  >  h  and  g  £  h.  Also  note  that  >  is 

transitive,  so  the  relation,  >,  defines  a  partial  order  on  a  set  G  =  H. 

The  relation,  "better  than"  will  form  the  cornerstone  of  the 
improved  algorithm  to  be  presented.  For  now,  we  will  pass  over  the 
question  of  how  to  determine  if  a  particular  single  spare  return 
function  is  better  than  another  in  favor  of  presenting  the  main  theorem 
of  this  chapter. 

Sequencing  Theorem 

Theorem  5.1:  Suppose  we  are  given  h. ,  ....  h  £  H  and  v  >  0.  If 

-  1  n  — 

h  3>  h  ,  then  there  exists  an  optimal  permutation  in  which  h  precedes 


This  can  be  seated  roughly  as  "always  use  the  best  spares  first," 
Thus,  if  we  are  given  a  List  of  pairs  of  functions  which  are  ordered  by 
>,  then  many  permutations  can  be  ruled  out,  and  the  expected  lifetime 
calculations  may  be  carried  out  for  a  smaller  number  of  permutations . 

Before  giving  the  actual  proof  of  this  theorem,  we  will  prove  two 
lemmas.  The  first  lemma  proves  that  H  is  closed  under  composition. 

The  second  lemma  is  essentially  a  proof  of  Theorem  5.L  for  n  =  3. 
Finally,  these  two  lemmas  will  be  combined  into  the  complete  proof  of 
the  theorem. 

Lemma  5.1:  Given  g,  h  e  H,  h«g  e  H. 

Proof :  This  will  be  done  in  three  steps,  one  for  each  condition 
which  hog  must  satisfy. 

1 .  g(h( v) )  >  h( v)  >  v. 

2.  v  >_  u  implies  that  h(v)  _>  h(u)  implies  that 
g( h( v ) )  2  g(h(u) ) . 

3.  v  >  u  implies  that  h(u)  -  u  >  h(v)  -  v,  while  h(u)  <_  h(v) 
implies  that  g(h(u))  -  h(u)  2  g(h(v)  -  h(v).  Adding  these  two 
inequalities  proves  that  g(h(u))  -  u  2  g(h(v))  -  v  as  required.  I 

Lemma  5.2:  Given  f,  g,  h  e  H  with  f  >  g  and  v  2  0,  then 
either  g(h(f(v)))  <_  f(h(g(v))), 
or  g(h(  f  ( v) ) )  <_  h(  f(g(v) )) . 

That  is,  there  exists  a  sequence  in  which  f  precedes  g  which  gives  a 
better  expected  lifetime  than  the  sequence  with  g  preceding  h 
preceding  f. 
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Proof :  Let  A  =  f(v)  -  g(v)  _>  0  and  u  =  g(v)  so  f(v)  =  u  +  A. 
Since  h  e  H,  h(u+A)  <_  h(u)  +  A.  Thus,  g(h(u+A))  <_  g(h(u)  +  A))  <_ 
g(h(u))  +  A.  If  g(h(u))  >  h(u)  then,  since  f  »  g  and  h(u)  _>  v, 
f(h(u))  -  g(h(u))  >_  f(v)  -  g(v)  =  A.  From  this  it  follows  that 
g(h(f(v)))  =  g(  h(  u+A ) )  _<  f  ( h(  u) )  =  f  ( h(  g(  v ) ) ) .  On  the  other  hand,  if 
g(h(u))  =  h(u),  then  g(h(f(v)))  =  h(f(v))  <_  h(f(g(v))),  which  completes 
the  proof.  [] 

Corollary  5.1:  f,g  e  H,  f  »  g  implies  that 
f (g(v) )  2  g(f(v))  for  all  v  2  0* 

Proof :  Take  h  in  the  previous  theorem  to  be  the  identity 
function,  h(v)  =  v.  C 

We  can  now  give  a  complete  proof  of  Theorem  5.1. 

Theorem  5.1:  Suppose  we  are  given  h^ ,  ...,  h^  e  H  and  v  2  0*  If 
h  »  h^ ,  then  there  exists  an  optimal  oermutation  in  which  h^  precedes 


Proof :  We  will  see  that,  given  any  permutation  t  in  which  h? 

precedes  h^ ,  we  can  find  a  permutation,  x ' ,  which  is  at  least  as  good 

as  x,  in  which  h^  precedes  h? . 

First  divide  the  permutation  x  into  five  (possibly  empty) 

subpermutations.  These  five  subpermutations  are:  the  functions  which 

precede  h0 ,  h, ,  the  functions  which  precede  h^  but  are  preceded  by 

h,,  hl(  the  functions  which  are  oreceded  bv  h, .  3v  Lemma  5.1,  each  of 
L  l  '  L 

these  tive  groups  is  equivalent  to  a  single  function  in  H.  If  a  group 
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r 


.1 


1 

i 

» 


..1 


is  empty,  then  represent  it  by  the  identity  function  g(x)  =  x,  which  is 
in  H.  Thus,  we  now  have 


P(n,v)  =  g1(g2(g3(g4(g5(v) ))))  , 
where  =  h2  and  g^  =  h^ . 

Since  these  functions  are  nondecreasing,  if  f(v)  >  g  (g  (g, ( v) ) ) 

L  j  -+ 

then  g  (f(g  (v)))  >_  P(n,v).  But  by  Lemma  5.2,  since  g4  »  g0 ,  either 

g3(g4(g2(v) ))  2  g2(g3(g4(v))) .  or 
g4(g3(g2(v)))  2  )  • 

Thus,  for  any  v  2  0,  there  is  a  permutation,  n '  with  h^  preceding 
h^  so  that  PC -rt '  ,  v )  2  P(t,v).  2 

Corollary  5.2:  If  h,  »  h„  2>  ...  >  h  ,  then  x.  =  i  is  an  optimal 
- < -  1  2  n  i 

sequence  for  any  v. 

Proof :  By  Theorem  5.1,  no  other  sequence  could  be  strictly  better. 


Thus,  if  the  set  of  functions  is  completely  ordered,  then  it  is 
trivial  to  find  an  optimal  sequence. 

The  following  definition  gives  a  name  to  the  permutations  which  do 
not  violate  the  result  of  Theorem  5.1. 

Definition  5.4:  A  permutation  will  be  called  feasible  if  no 
function  precedes  a  strictly  better  function.  I 


50 


In  light  of  this  definition,  a  shorter  statement  for  Theorem  5.1  would 
be  that  the  best  feasible  permutation  is  an  optimal  permutation.  The 
next  proposition  provides  a  bound  on  the  number  of  feasible 
permutations . 

Proposition  5.1:  Suppose  {h^  ,  h^,...,!^}  can  be  broken  down  into  k 
disjoint  sets,  1^ ,  ...,  I^»  such  that  each  set  is  completely  ordered  and 
set  1^  contains  n^  elements,  i  =  1,2 . k.  Then  at  most 

_ nj _ 

V  V  •••  V 

permutations  are  feasible. 

Proof :  Functions  from  within  a  set  can  appear  in  a  feasible 
permutation  in  only  one  order,  but,  in  general,  functions  from  different 
sets  may  appear  in  any  order.  The  actual  result  is  a  standard 
combinatorial  fact.  G 

Consider  the  following  numerical  example.  If  n  =  10  and  we 
checked  all  permutations,  then  10!  =  3,628,800  evaluations  would  have  to 
be  done.  However,  if  two  completely  ordered  groups  of  size  5  exist, 
then  only  10 ! / 5 ! 5 !  =  252  permutations  need  to  be  checked. 

At  this  point,  it  is  tempting  to  suggest  that,  for  f,g  e  H,  if 
f(g(v'))  >  g(f(v' ))  for  some  v'  >  0,  then  f(g(v))  >  g(f(v))  for  all 
v  >  0.  That  is,  if  one  spare  is  better  than  another  for  some  v,  then 
maybe  it  actually  is  better  for  all  v.  Following  is  a  counterexample 
to  this  claim.  We  will  consider  two  spares  with  known  mean  and 


variance.  Suppose  the  first  spare  has  an  expected  lifetime  of  1  with  a 
standard  deviation  of  .2,  and  the  second  spare  has  an  expected  lifetime 
of  2  with  a  standard  deviation  of  .4.  Let  n  =  {1,2}  and  it.  =  (2,1}. 
Then,  for  v  =  0,  PCu^.v)  =  2.22  while  P(it2>v)  =  2.11.  But,  for  v  = 
3.7,  P(rc^,v)  =  4.21,  while  P(n2>v)  =  4.23.  Thus  depending  on  the  value 
of  v,  different  orders  may  be  optimal. 


Before  we  can  apply  Theorem  5.1,  we  need  to  know  when  a  particular 
single  spare  return  function  is  better  than  another.  As  an  example,  we 
will  consider  known  percentile  miniraax  spares.  Then  we  will  move  on  to 
the  more  interesting  cases  of  spares  with  completely  known  distributions 
and  miniraax  spares  with  known  mean  and  variance. 


Proposition  5.2:  hp^g^  is  better  than  hp^s^  when  pi  —  p2  and 


S1  ^  V 


Proof:  For  the  duration  of  this  proof,  let  h.  =  h.  c  .  for 
-  r  i  pi,si 


i  =  1,2.  We  need  to  verify  two  conditions. 


1.  hj(v)  h2(v)  since  (1-pj)  >_  (l-p2>,  Sj  _>  s2 ,  and  s^O-p^J/pj 

>  s2(l-p2)/p2. 

2.  h2(v)  >  v  implies  that  0  <_  v  <  s2(l-p2)/p2,  in  which  case 
v  <  v^  and  hj,(v)  =  1— p^  >_  l-p2  =■  h2(v).  3 


As  usual,  the  percentile  case  was  handled  easily.  The  next  two 


theorems  provide  sufficient  conditions  for  one  spare  to  be  better 


than  another  for  spares  with  known  lifetime  distributions  and  for  spares 
with  known  mean  variance. 


Theorem  5.3:  Let  F  and  G  have  continuous  densities,  and  assume 
F(t)  _>  G(t),  t  2l  0.  If  F(  t  p(  v ) )  !>  G(  t^(  v) )  for  all  v,  then 

hF  >  V 

Proof:  First,  F  >  G  ensures  that  L  (t.F)  >  L  (t,G)  for  all  t 
-  —  v  —  v 

and  v,  so  h  (v)  >  h  (v)  for  all  v  >  0.  Now, 

F  ““  G 


hp( v )  =  tp(v)( F( tp( v) )  -  vf(tp(v)))  +  F( tp( v) ) , 


But,  since  t  (v)  is  optimal,  F(t  (v))  =  vf(t  (v)),  so 
F  F  F 

h'(v)  =  F(t  (v))  and  h'(v)  >  h'(v)  if  and  only  if 
F  F  F  G 

F(  t p(  v) )  G(  t^(  v) ) .  £ 


Theorem  5.4:  If  p,  >  p„  and  a,  <  a„ ,  then  h„  „  >  h ,,  „  . 

I  —  i  \  —  L  H.  *  l  ^2  ’  2 

Proof :  Let  h^  =  hu^>a  for  i  =  1,  2.  In  Theorem  4.1,  it  was 

proven  that  h  is  increasing  in  u  and  decreasing  in  a,  provided 

P ,  cr 

h  (v)  >  v.  If  a-  <  v  then  u,  =  min{2a,  ,  p}  <  2 ct_  =  "JL  and 
u,0  l  2  1  1—24 

V,  >_  v^ ,  so  that,  if  h^(v)  =  max{p^,v}  then  h^(v)  *  maxtp^.v} 

max{p^,v}.  Thus,  h^  >_  h^ .  If  ^  =*  then  h^  >_  h^  since  p^  u^. 

To  see  that  h^(v)  >_  h^(v)  when  h^(v)  >  v  (v  <_  v^)  ,  recall  from 

2  2  2 

the  proof  of  Lemma  4.1:  h'  (v)  =  (  u-t  (v))  /(  a  +(  u.-t  (v))  ) 

P,o  p, a  p, a 

when  h  (v)  >  v.  So  h'  is  constant  in  p,  since  j.  -  t  is 
p,a  u,o  •  p,  o 

constant  in  p,  and  decreasing  in  a  as  required.  Once  again  we  have 


1  -  T 


used  Che  fact  that  v^  >.  v^.  _ 
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Thus,  for  spares  with  known  mean  and  variance,  "better  than"  can  be 


interpreted  in  a  very  natural  sense. 

Eliminating  Spares 

One  final  technique  can  be  used  which  may  further  reduce  the  number 
of  permutations  which  need  to  be  checked.  Suppose  we  were  given  a  spare 
along  with  its  distribution.  If  we  then  discovered  that  this 
distribution  was  NWIIE,  then,  by  Proposition  2.1,  we  would  know  that 
using  this  spare  before  other  spares  could  not  strictly  help  us  except 
through  its  mean.  More  precisely: 

Theorem  5.5:  Given  h^ ,  ...,  h^  £  H  and  h^(v)  =  max{v,h^(0)}  for 
all  v  ^  0.  Then,  for  any  v  ^  0,  there  exists  an  optimal  sequence  in 
which  hj  precedes  no  other  spares. 

Proof :  Suppose  h^  directly  precedes  .  Then  h^Ch^Cv))  = 
maxCh^C v) .h^CO) }  <_  h^Ch^Cv)).  Thus  h^  need  not  precede  any  other 
spare.  I 

Thus,  a  spare  with  u  =  v  can  contribute  only  through  its  mean. 

If  two  or  more  spares  have  this  property,  then  only  the  one  with  the 
largest  mean  need  be  used.  Further,  it  may  be  possible  to  identify 
other  spares  which  need  not  be  used. 

Theorem  5.6:  If  =  v^  and  v^  <_  then  no  advantage  may  be 
gained  through  the  use  of  the  second  spare. 


Proof :  From  Theorem  5.5,  we  know  chat  we  would  get  no  advantage  in 
having  spare  1  precede  spare  2.  However,  if  spare  2  precedes  spare  1, 
then  we  also  get  no  advantage  since  the  reward  for  successful 
replacement  of  spare  2  would  be  at  least  p^  >_  v^.  □ 

Computational  Example 

Example  5.1:  Suppose  we  have  five  spares  which  need  to  be 
scheduled.  We  know  the  distribution  of  the  first  spare,  and  it  has  the 
density,  f(t)  *  2t,  0  t  <_  1 .  For  the  second,  third,  and  fourth 
spares,  we  know  only  their  mean  and  variance.  Specifically,  the  second 
spare  has  mean  1  and  standard  deviation  .4.  The  third  spare  has  mean 
l.l  and  standard  deviation  .35.  The  fourth  spare  has  mean  2/3  and 
standard  deviation  2/3.  The  fifth  and  last  spare  has  its  median  at  time 
1/2.  This  information  is  summarized  in  Table  5.1.  Since  no  other 
spares  are  available  to  us,  we  will  take  v  =  0. 


Spare 


Spare  T 


Information 


complete 

information 

f(t) 

m 

2t, 

0<t<l 

minimax , 

known 

mean  and  variance 

P  = 

1, 

a 

*  .4 

minimax, 

known 

mean  and  variance 

P  = 

l.l 

,  o 

-  .35 

minimax , 

known 

mean  and  variance 

p  => 

2/3 

.  O 

-  2/3 

minimax , 

known 

percentile 

s  * 

1/2 

.  p 

*  1/2 

Table  5 

.1  Spare  Definitions 

In  deciding  on  the  optimal  sequence  for  these  spares,  three  things 
should  be  noted.  The  first  is  that  the  fourth  spare  has  p  =  v  since 
the  mean  is  less  than  twice  the  standard  deviation.  This  means  that 
this  spare  must  be  scheduled  last.  The  next  important  fact  is  that  the 
fifth  spare  has  v  =  1/2,  which  is  less  than  2/3,  the  mean  of  the  fourth 
spare.  Thus,  using  the  fourth  spare  cannot  help  us  at  all.  The  final 
important  fact  to  note  is  that  the  third  spare  is  better  than  the  second 
spare,  so  the  third  spare  precedes  the  second  spare  in  any  feasible 
sequence. 


Permutation 

PU.O) 

nl 

-  1, 

n2  =  3*  *3  = 

2. 

71.  55  4 

4 

1.45 

*1 

-  3, 

U2  =  l»  n3  = 

2. 

K,  =  4 

4 

1.42 

*1 

=  3, 

*2  =  2*  u3  a 

1, 

ii 

& 

1.33 

Table  5.2  Permutation  Evaluations 

Thus,  only  three  sequences  remain  to  be  checked.  They  are  listed 
in  Table  5.2  along  with  their  expected  lifetimes.  From  examining  these 
expected  lifetimes,  it  is  apparent  that  the  first  sequence  listed  is  an 
optimal  sequence.  3 


Chapter  6 


Extensions 


This  chapter  will  treat  two  extensions  to  the  Basic  Model,  which 
has  been  the  focus  of  our  work  so  far.  These  extensions  are  not  simply 
different  assumptions  about  the  lifetimes  of  the  spares  but  are 
structural  variations  of  the  Basic  Model.  In  both,  it  is  assumed  that 
the  complete  lifetime  distribution  of  the  identical  spares  is  known. 

Spares  in  Parallel 

The  first  extension  to  be  discussed  deals  with  the  idea  of  using 
spares  in  parallel.  As  such  it  will  be  called  the  Parallel  Model. 

Parallel  Model:  The  spares  are  aggregated  into  arbitrarily-sized 
groups  and  these  groups  are  scheduled  in  an  arbitrary  sequence.  The 
failure  time  of  a  group  is  the  largest  failure  time  of  the  spares  in  the 
group.  As  in  the  Basic  Model,  the  lifetime  of  the  entire  system  is  the 
time  until  the  first  failure  of  an  installed  group. 

The  first  thing  to  notice  is  chat  the  Parallel  Model  yields 
expected  lifetimes  which  are  no  worse  than  the  Complete  Information 
Model  because  we  could  choose  each  of  our  groups  to  have  only  one 
spare.  It  is  tempting  to  think  that  it  would  always  be  best  to  have  one 


large  group  of  spares,  since  this  would  minimize  the  chance  of  a  very 


early  failure.  However,  when  the  spares  are  reliable  early  in  their 

lifetimes,  this  would  waste  quite  a  bit  of  potential  expected  lifetime 

by  overlapping  the  reliable  portions  of  the  spares'  lifetimes. 

We  now  consider  the  problem  of  determining  the  single  spare  return 

function  for  a  group  of  n  spares.  As  in  Chapter  2,  let  F  be  the 

cumulative  distribution  function  of  the  lifetime  of  a  single  spare. 

Also,  let  p  be  the  expected  lifetime  of  a  spare.  Let  F^n^  denote 

the  cumulative  distribution  function  of  the  lifetime  of  a  group  of  n 

spares.  Since  the  group  fails  if  and  only  if  every  component  in  the 

group  fails,  F^n^  =  Fn.  So,  if  h  is  the  single  spare  return 

n 

function  for  a  group  of  n  spares, 


h^Cv)  =  supt  lv(t,Fn). 


It  is  a  simple  calculation  to  find  the  failure  rate  for  a  group  of 
n  spares: 


rn(t) 


nFn"L(t) 
l  -  Fn(t) 


As  stated  in  Chapter  2,  the  optimal  replacement  time,  t^Cv), 

satisfies  r  (t  (v))  *  1/v.  The  actual  solution  of  r  (t)  *  1/v  to 
n  n  n 

find  t  (v)  and  h  (v)  must  be  undertaken  on  a  case  by  case  basis 
n  n 

depending  on  the  spare  Lifetime  distribution,  F.  If  F  is  IFR 
then  F^°^  is  also  IFR.  See  Barlow  and  Proshan  [  1965  j  pp.  38-39  for  a 
proof  of  this  fact.  In  this  case,  the  equation,  r^(t)  ”  1 / v ,  is  easy  t 
solve  numerically  using  a  one-dimensional  search. 


Assuming  that  we  can  solve  for  hn(v),  the  optimal  grouping  and 
sequencing  for  a  set  of  spares  may  be  found  by  the  following  method. 

Let  un  be  the  optimal  expected  lifetime  with  n  spares.  Assume  u^ 
is  known  for  1  <_  k  <_  n,  and  u^  =  4.  Then  un+^  may  be  calculated 
according  to  the  following  equation. 

Vr^KKnVVl-i5’  n^1* 

In  this  expression,  i  represents  the  size  of  the  initial  group, 
and  b^(un+^_^)  is  the  expected  lifetime  using  a  group  of  size  i 
followed  by  the  optimal  use  of  the  remaining  n+l-i  spares. 

Thus,  if  u^  Is  known  for  1  k  £  n,  then  h^  must  be  evaluated 

once  for  each  i  e  { 1 ,  ...,  n}  in  order  to  find  un+1* 

The  next  theorem  says  that  no  matter  what  lifetime  distribution  we 
have,  provided  it  is  not  degenerate  at  0,  the  limiting  expected 
lifetime  is  infinite. 

Theorem  6.1:  lim  _  u  ■  provided  F(0)  <  1. 

-  n-*'00  n 

Proof :  Since  F(0)  <  1,  there  exists  e  >  0  so  that  F( e)  =  p  <  1 

Let  wn(m)  be  the  expected  lifetime  using  the  periodic  schedule,  z,  on 

n  groups  of  size  m  each.  Then  lim  w  (m)  >  £(l-pm)/pra  since 

n-*«°  n  — 

(l-pm)/pm  is  the  expected  number  of  groups  which  survive  before  the 
first  failure.  Clearly,  lim^^  w^m)  can  be  made  as  large  as 
necessary  by  choosing  m  large  enough.  2 

We  will  now  consider  an  example  of  the  calculation  of  the  optimal 
grouping  and  scheduling  of  spares. 


Example  6.1:  Let  Che  distribution  of  the  spares  be  uniform  on 
10,1],  so  F(t)  «  t,  0  <  t  <  1.  Then  F(n)(t)  =  Fn(t)  =  tn,  tn(v) 
satisfies : 

t  (v)  +  vnt  (v)n  1  -  1  =  0, 
n  n 

►  r  \n+1 

t  (v) 

and  h  (v)  »  t  (v) - — : —  +  (1  -  t  (v)  )v. 

n  n  n  +  l  n 

Table  6.1  lists  the  optimal  grouping  and  sequencing  for  n  up  to 
8.  The  "sequence"  column  is  read  as  follows:  for  n  =  3,  the  optimal 
sequence  is  a  group  of  size  two  followed  by  a  group  of  size  one.  □ 

n 

1 

2 

3 

4 

5 

6 

7 

8 

Table  6.1  Optimal  Groupings  and  Expected  Lifetimes 

Note  that  in  the  example  given,  larger  groups  always  precede 
smaller  groups.  It  is  not  known  if  this  is  true  in  general.  Since 
F^n^  <_  F^n+^\  it  may  be  that  Theorem  5.3  could  be  applied  to 
prove  that  h  is  better  than  h  and  that  larger  groups  would 


precede  smaller  groups.  The  problem  lies  in  proving  p(n+D(t  (v)) 

n+ 1 

>  F^n\t  (v))  for  all  v. 
n 

Also  note  that  it  is  not  true  that  u  ,  -  u  <u  -  u  ,  in 

n+1  n  —  n  n-1 

general,  since  u,  -  u„  >  ur  -  u. .  The  reason  for  this  seems  to  be  the 
6  5  5  4 

integrality  of  the  spares.  Thus,  if  the  groups  could  consist  of  a 
non-integral  number  of  spares,  then  perhaps  this  result  would  be  true. 


One  More  Spare 

The  second  extension  to  be  treated  involves  the  idea  of  receiving 
an  additional  spare  at  some  time  in  the  future.  This  might  be  the  case 
if  the  limited  availability  of  spares  is  caused  by  long  production 
times.  For  instance,  we  might  have  an  additional  component  under 
construction  but  unavailable  for  a  relatively  long  time.  This  model 
will  be  known  as  the  Additional  Spare  Model. 

Additional  Spare  Model:  As  in  the  Complete  Information  Model,  n 
spares  are  available  for  immediate  use,  and  one  additional  spare  will 
become  available  t  units  of  time  from  now.  The  extra  spare  cannot  be 
used  if  the  system  has  already  failed  before  delivery  of  the  extra 
spare.  All  other  assumptions  of  the  Complete  Information  Model  apply. 

Let  v(n,t)  be  the  optimal  expected  lifetime  with  n  spares 
available  now  and  an  additional  spare  available  t  units  of  time  from 
now.  If  t  *  0,  then  the  additional  spare  has  already  been  received. 
Thus  v(n,0)  corresponds  to  v^  as  defined  in  Chapter  2. 
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The  following  equations  define  v(n,t)  for  all  n  and  t. 


v(0,t)  =0,  t  >_  0, 

v(n,0)  =  sup^  Lv('n_1  g)  ( y  >F) ,  n  “  1,  2,  ....  and 
v(n,t)  =  max(supy<t  >t_y)(y  ,F> , 

sup^ ^  ^  0)^*^  '  ’  ^  =  1>  2 ,  •  •  •  5  t  >  0. 

The  calculation  of  v(n,0)  is  exactly  the  same  as  the  calculation 

of  v  described  in  Chapter  2.  The  calculation  of  v(n,t)  for  t  >  0 
n 

is  complicated  by  the  fact  that  v(n-l,s)  must  be  known  for  all  s  in 
[0,t] .  Thus,  numerical  solution  is  impractical  and  the  calculations 
must  be  done  analytically.  Several  monotonicity  results  are  available. 

Theorem  6.2:  v(n+l,0)  v(n,t),  n  _>  l ,  t  >  0 . 

Proof :  The  only  difficult  part  of  the  proof  is  to  show  that 
v(n,0)  v(n-l,t-y)  for  0  £  y  £  t.  This  follows  inductively.  For 
n  =  0,  v(  1 ,0)  =  u  >_  0  =  v(0 ,  t) .  From  v(n,0)  >_  v(n-l,t-y),  t-y  >  0,  it 
follows  that  v(n+l,0)  v(n,t),  t  >  0  by  using  the  same  schedule  on 

v(n+l,0)  as  is  optimal  for  v(n,t).  2 

Thus,  it  is  better  to  have  the  extra  spare  right  now  than  to  wait 
for  the  spare.  As  the  next  theorem  shows,  it  is  also  better  to  receive 
the  spare  sooner  than  later. 

Theorem  6.3:  v(n,t^)  _>  v(n,t2>,  n  _>  1 ,  t^  <_  t, . 


Proof:  We  will  refer  to  t 


t . 
1 


as  case  i. 


If  in  case  1,  we 


follow  the  optimal  strategy  from  case  2,  then  we  will  eventually  be  in 
the  situation  that  case  1  has  received  its  extra  spare  while  case  2  has 
not.  This  returns  us  to  the  situation  of  the  previous  theorem  which 
completes  this  proof.  □ 

It  is  also  trivially  true  that  additional  spares  are  better,  i.e. 
v(n+L,t)  _>  v(n,t),  t  _>  0,  which  follows  by  choosing  v  =  0  in  the 
optimization  of  v(n+l,t). 

The  final  result  of  this  section  is  that  the  replacement  time 

increases  as  the  time  until  the  additional  spare  is  received  increases. 

Thus,  we  extend  our  replacement  times  in  the  hope  of  actually  receiving 
the  additional  spare  before  using  up  our  current  allotment  of  spares. 

Let  x(n,c)  be  the  smallest  optimal  replacement  time  yielding  v(n,t), 

n  _>  l ,  c  _>  0. 

Theorem  6.4:  xtn.t^)  <_  x(n,t2),  n  >  1,  0  <  tj  <  t,. 

Proof :  Let  x^  =  x(n,t^)»  i  =  i,  2.  Also,  for  i  =  1,  2,  let 

(  v(n-l , t . -y ) ,  y  <  t. , 
v.(y)  =  1 

I  v(n,Q) ,  y  >  t  . 

Recall  that  v^(y)  >_  v^(y)  and  v  is  nondecreasing  in  v.  Thus, 
v^(v)  is  the  reward  we  receive  for  successful  substitution  after  time 
y  in  case  i.  Now, 

v(n’ck  ’  k,  r,  i  -  l,  2.  i 


So  v(o,t1)  -  v(n,c2>  >  LVi(Xi)Cx2,F)  -  L^jUj.F) 

=  FCx^ )  (  vj  (  xj  )  “  v2^x2^’ 

and  v(n,tl)  -  v<n,t2>  <  ,F) 

=  F(x^)(v^(x^)  -  v2(x2)). 

Thus,  F(x^)(v^(x^)  -  v 2 ( x^ ) )  >_  FCx^Hv^x^)  -  v2(x2)). 

We  will  consider  three  cases  on  the  sign  of  v^(x^)  “ 

Case  L:  If  v^(x^)  =  v2(x9)  then,  either  x^  <_  x2  or  <  x^ 
and  v^(x)  =  v2(x)  =  c  for  x  £  [x2>x^].  In  this  case,  x^  >  x2 
contradicts  their  optimality  since  ^^(x.F)  and  Lv  (X^(X>F)  agree 

for  x  £  [x2 ,x  ] . 

Case  2:  If  v  (x  )  <  v  (x  )  then  x  x  since  v  v0  and  the 
v^  are  nondecreasing. 

Case  3:  FinalLy,  if  v^(x^)  >  v2(x?),  then  F(x^)  >_F(x2>.  Now, 
if  F(x^)  >  F(x2)  then  x^  <_  x2  since  F  is  nonincreasing.  If 
F(x^)  =  F(x2)  then  it  is  possible  that  x^  <  x^ ,  but  x2  <  x^  would 
contradict  their  optimality  since  x?  could  be  increased  to  x^ , 
strictly  improving  Lv  ^^(x.F).  I 

Theorem  6.5:  x(n+l,0)  <  x(n,t),  n  _>  l ,  t  >  0. 

Proof :  This  proof  is  the  same  as  in  the  previous  theorem  with  the 


appropriate  redefinition  of  v,  and  v,,.  In  effect,  we  now  have 


It  should  be  noted  that  if  x(n+l,0)  >  t  then  v(n+l,0)  =  v(n,t) 
and  x(n+L,0)  =  x(n,t).  This  is  simply  the  statement  that,  if  we  did 
not  need  to  wait  for  the  extra  spare  then  we  get  the  same  schedule  and 
expected  lifetime;  whether  or  not  we  have  the  spare  right  now. 

In  fact,  this  result  can  be  extended  to  the  following.  If 
t  <  x(n+l,0)  +  x(n,0)  +  ...  +  x(2,0)  then  v(n+l,0)  =  v(n,t)  and 
x(n+l,0)  =  x(n,t).  That  is,  we  put  together  our  normal  schedule,  and  if 
the  total  time  until  we  use  the  last  spare  is  more  than  the  time  we  must 
wait  for  our  extra  spare,  then  we  can  use  the  normal  schedule  and  get 
the  same  return  after  waiting  for  the  spare. 

The  importance  of  this  fact  is  that  it  can  make  determining  an 
optimal  schedule  much  easier  if  the  time  until  the  extra  spare  is 
received  is  not  very  large  compared  to  the  replacement  times  when  few 


spares  are  available 


Chapter  7 


Conclusions 


In  the  previous  chapters,  we  have  defined  and  discussed  a  model 
which  is  easier  to  implement  than  the  spare  replacement  model  presented 
by  Derman  et  al.  [1984].  The  implementation  of  the  minimax  model  with 
known  mean  and  variance  is  easier  for  two  reasons.  The  first  is  that 
less  information  need  be  known  about  each  spare.  In  particular,  we 
assume  chat  only  the  mean  and  variance  of  the  spare  lifetime  is  known, 
in  comparison  to  knowledge  of  the  entire  spare  lifetime  distribution 
required  by  Derman  et  al.  Secondly,  in  our  model  it  is  simple  to  find 
optimal  schedules  and  expected  lifetimes  through  a  sequence  of 
one-dimensional  searches  described  in  Chapter  3.  In  Derman  et  al.,  this 
calculation  deoends  on  the  particular  lifetime  distribution,  and  is  easy 
for  some  distributions  and  very  difficult  for  others. 

Not  only  have  we  relaxed  the  requirement  that  the  spare  lifetime 
distribution  be  known,  but  the  problem  of  sequencing  different  spares 
was  considered  in  a  general  context  in  Chapter  5.  Finally,  two 
extensions  to  the  Basic  Model,  the  Extra  Spare  Model  and  the  Parallel 
Model,  have  been  presented  and  discussed.  In  all  cases,  computational 


methods  have  been  provided  for  determining  optimal  schedules  and 
expected  system  lifetimes. 


Further  Research 


Further  research  may  prove  fruitful  in  a  number  of  the  following 
areas.  The  areas  are  divided  into  three  categories:  refinements, 
extensions,  and  new  models,  which  will  be  discussed  in  this  order. 

One  obvious  possibility  for  refinement  would  be  an  algorithm  for 
sequencing  spares  (Chapter  b)  which  does  not  rely  on  enumeration.  The 
problem  with  the  given  algorithm  is  that,  in  the  worst  case,  n! 
permutations  must  be  evaluated.  It  seems  that  an  algorithm  could  exist 
which  would  have  a  better  worst  case  performance  than  the  given 
algorithm.  Of  course,  the  actual  performance  will  depend  on  the  actual 
spares  which  must  be  sequenced. 

A  related  issue  is  that  there  may  exist  a  better  sufficient 
condition  for  one  spare  to  precede  another  than  f  »  g.  If  such  a 
condition  is  found,  then  it  could  be  the  case  that  fewer  permutations 
would  have  to  be  evaluated,  although,  in  the  worst  case,  n! 
permutations  would  still  have  to  be  evaluated.  According  to  the 
counterexample  in  Chapter  5,  there  does  not  exist  a  condition  so  that 
given  any  two  functions,  one  of  them  always  precedes  the  other. 

However,  it  is  certainly  possible  that  a  condition  is  available  which  is 
more  discriminating  than  f  »  g. 

A  reasonable  extension  to  the  assumption  of  known  mean  and  variance 
in  Chapters  3  and  4  is  the  knowledge  of  additional  moments  of  the  spares 
lifetime  distribution.  If,  for  example,  we  assumed  knowledge  of  the 


firsc  k  moments  of  the  lifetime  distribution,  then  Hoeffding's  result 
could  be  applied  to  reduce  the  problem  to  consideration  of  ( k+1 )-point 
distributions.  It  would  then  be  possible  to  write  equations  for 
p^  in  terms  of  y  ,  y^+^  and  proceed  as  in  Chapter  3. 

It  is  expected  that  all  monotonicity  results  for  replacement  times  as 
well  as  expected  lifetimes  would  carry  over  from  the  known  mean  and 
variance  model  to  the  k-moment  model.  Further,  once  the  single  spare 
return  function  is  found,  it  is  not  hard  to  find  optimal  schedules  and 
expected  lifetimes  for  multiple  identical  spares  and  this  new  type  of 
spare  could  be  integrated  into  the  framework  for  optimal  sequencing  of 
different  spares  presented  in  Chapter  5. 

There  are  several  classes  of  distributions  which  yield 
uninteresting  minimax  schedules.  One  is  the  class  of  distributions  with 
known  mean.  Since  the  exponential  distribution  is  NWUE,  its  single 
spare  return  function  is  simply  the  maximum  of  its  mean  and  the  reward. 
Thus,  the  miniraax  single  spare  return  function  for  spares  with  a  given 
mean  is  also  the  maximum  of  the  mean  and  the  reward.  In  fact,  even  if 
we  require  that  the  spares  have  an  IFR  distribution,  in  addition  to  a 
given  mean,  we  can  do  no  better.  This  is  because  the  exponential 
distribution  is  also  IFR. 

The  class  of  distributions  with  more  than  one  known  percentile 
yields  somewhat  more  interesting  rainimax  schedules  than  the  class  with 


only  one  known  percentile.  These  schedules  are  easy  to  find  since  there 


is  one  minimizing  distribution,  Independent  of  the  schedule.  As  in  the 
single  percentile  model,  the  optimal  schedules  all  involve  replacement 


times  which  are  the  known  percentiles  of  the  lifetime  distribution. 

Thus,  by  determining  the  specific  percentiles,  the  optimal  schedule  is, 
to  a  large  extent,  determined  in  advance. 

New  Models 

The  following  three  new  models  are  useful  in  a  practical  sense, 
although  they  are  also  more  complex  analytically  than  models  treated  so 
far.  The  first  is  a  model  with  deteriorating  spares.  By  this  we  mean 
that  the  lifetime  distribution  of  a  spare  is  a  function  of  its  age  upon 
installation.  Thus,  the  shelf  life  of  the  spares  is  an  important  factor 
in  the  decision  about  when  to  make  replacements. 

Deteriorating  Spares  Model:  Everything  is  the  same  as  the  Complete 
Information  Model  except  that  the  lifetime  distribution  of  a  spare  is  a 
function  of  its  age  at  the  time  it  is  installed.  It  is  assumed  that  all 
spares  begin  with  the  same  age.  Thus,  any  spare  installed  at  a 
particular  time  will  have  the  same  lifetime  distribution  as  any  other 
spare  installed  at  that  time. 

Let  be  the  cumulative  distribution  function  of  a  spare 

installed  at  time  t.  Spares  which  are  deteriorating,  but  deteriorate 
more  quickly  when  being  used  satisfy  the  following  inequality: 

Vs)  2.  ^t+A<s)  2  F  (s+A) ,  t,s,A  >  0. 

That  is  to  say,  a  younger  spare  is  better  than  an  older  spare  and  an 
unused  spare  is  better  than  a  used  one.  This  apparently  is  the  only 


restriction  on  a  family  of  lifetime  distributions  to  be  consistent  with 
the  idea  of  deteriorating  spares. 

It  is  simple  to  define  a  recursive  relation  yielding  optimal 
schedules  and  expected  lifetimes.  Let  u(n,t)  be  the  optimal  expected 
lifetime  beginning  with  n  spares  each  of  which  has  age  t  now.  Then 
u  satisfies  the  following  recursion: 

u(0,t)  *  0,  t  _>  0, 

y_ 

u(n+l  ,t)  =  sup  {/  F  (x)dx  +  F  (y)u(n,t+y)  } ,  n  >_  0,  t  ^  0. 
y>0  0  C  C 

The  problem  with  solving  this  recursion  lies  in  the  fact  that  in 
order  to  find  u(n+L,t),  we  need  to  know  u(n,s)  for  all  s  ^  t.  As  in 
the  Additional  Spare  Model,  presented  in  Chapter  6,  this  makes  numerical 
solution  impractical.  In  fact,  this  model  might  be  harder  to  solve 
numerically  than  the  Additional  Spare  Model  because,  in  the  Additional 
Spare  Model  the  reward  function  only  had  to  be  known  for  arguments  in  a 
finite  interval. 

It  is  straight-forward  to  prove  that  u(n,t)  is  nondecreasing  in 
n  and  nonincreasing  in  t.  That  is,  it  is  better  to  have  more  spares 
and  to  have  younger  spares,  as  we  should  have  suspected  anyway. 

However,  any  other  results  seem  difficult  at  best.  The  next  step  in  the 
analysis  of  this  model  would  be  to  further  restrict  the  family  of  spare 
lifetime  distributions,  F^.  Presumably,  the  appropriate  restriction 
would  enable  one  to  obtain  more  interesting  results. 


70 


Another  possibility  is  to  apply  the  minimax  approach  to  this 
problem.  Once  again,  there  is  little  hope  for  a  good  solution  unless  a 
closed  form  expression  (in  t)  can  be  found  for  u(n,t).  However,  it  is 
probably  true  that  the  general  results  for  the  minimax  case  are  the  same 
as  for  the  case  of  a  known  family  of  distributions. 

For  an  even  more  difficult  problem,  the  spares  could  initially  have 
different  ages,  which  would  add  the  aspect  of  optimal  sequencing  to  the 
problem  of  optimal  scheduling.  This  extension  of  the  Deteriorating 
Spares  Model  would  still  suffer  from  the  same  problems  of  the 
impracticality  of  numerical  solution.  This  would  be  compounded  by  the 
necessity  to  check  a  number  of  different  permutations. 

Another  interesting  new  model  is  one  which  allows  spares  to  be 
reused  after  they  have  been  replaced.  Various  assumptions  are  possible 
about  what  lifetime  distribution  a  reused  spare  would  have  and  how  many 
times  a  spare  could  be  reused. 

The  most  obvious  lifetime  distribution  assumption  is  that  the 
lifetime  distribution  of  a  reused  spare  is  simply  the  distribution  of 
its  remaining  lifetime  at  the  time  it  was  removed.  That  is,  there  is  no 
penalty  for  removing  and  then  reinstalling  a  spare.  If  we  also  assume 
that  spares  can  be  reused  infinitely  often,  then  it  is  easy  to  see  how  a 
group  of  spares  would  be  utilized.  The  installed  spare  would  always  be 
the  one  with  the  lowest  current  failure  rate.  If  the  installed  spare's 
failure  rate  ever  rose  above  the  failure  rate  of  the  next  "best"  spare 
then  they  would  be  immediately  exchanged.  Note  that  this  could  lead  to 
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continuous  installation  and  removal  of  spares.  This  is  obviously  not  a 
practical  solution. 

One  way  to  deal  with  the  problem  of  continuous  swapping  of  spares 
would  be  to  limit  each  spare  to  some  fixed,  finite  number  of  reuses. 
Another  way  would  be  to  significantly  penalize  a  spare  at  the  time  it  is 
removed  so  that  it  would  not  be  optimal  to  install  and  remove  a  spare 
continuously.  In  either  case,  this  problem  becomes  complicated  quickly 
since  once  a  number  of  spares  are  waiting  to  be  reused,  they  will 
probably  have  different  lifetime  distributions.  Therefore,  an  optimal 
sequence  must  be  determined,  taking  into  account  that  the  spares  can  be 
reused  again. 

The  final  new  model  which  will  be  discussed  is  actually  a 
generalization  of  the  Parallel  Model  presented  in  Chapter  6.  Now  we 
assume  that  spares  may  work  in  parallel,  but  that  they  can  be  installed 
and  removed  independently  of  each  other. 

Super-Parallel  Model:  This  model  is  the  same  as  the  Complete 
Information  Model,  except  that  when  a  new  spare  is  installed,  the  old 
spare(s)  need  not  be  removed.  The  system  fails  at  the  first  time  all 
installed  spares  have  failed.  This  differs  from  the  Parallel  Model  in 
that,  with  the  Parallel  Model,  a  group  of  spares  must  be  removed  before 
a  new  group  may  be  installed. 

The  first  question  to  be  considered  is  whether  the  status  of 
installed  spares  may  be  used  in  the  new  installation  decisions. 
Presumably,  the  static  model,  in  which  all  installation  times  must  be 
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determined  in  advance,  is  easier  to  solve  and  the  solution  is  easier  to 


implement. 

It  is  possible  to  define  a  recursion  for  an  optimal  static  policy, 
although  it  seems  difficult  to  solve.  As  in  Chapter  2,  we  will  take  F 
to  be  the  distribution  function  for  the  spares.  Let  v(n,G)  be  the 
optimal  expected  lifetime  with  n  uninstalled  spares  assuming  that  the 
currently  installed  group  has  the  remaining  lifetime  distribution  G. 
When  no  spares  are  available,  then  the  only  strategy  is  to  wait  for  the 
installed  group  to  fail. 


03 

v(0,G)  =  /  G(x)dx,  and 
0 


t 

v(n+i,G)  =*  sup  (/  G(x)dx  +  v(n,H  )G( t)  } , 
t>0  0  r 


where 


Ht(s)  = 


G( t+s)  -  G(t) 
l-G(t) 


Thus,  is  the  remaining  lifetime  distribution  of  the  newly 

expanded  group,  conditional  on  the  old  group  surviving  to  t.  Once 
again  we  find  that  the  reward,  v(n,H  ),  is  a  function  of  t.  Thus, 
numerical  solution  is  impractical  and  the  recursion  must  be  solved 
analytically. 

We  now  consider  the  problem  of  determining  an  optimal  dynamic 
policy:  a  policy  which  can  take  account  of  the  fact  that  a  certain 
installed  spare  has  failed.  An  obvious  strategy  in  this  case  is  to 
initially  install  two  spares  and  then  install  a  new  spare  each  time  an 


installed  spare  fails.  It  is  not  clear  why  such  a  policy  would  be 
optimal,  but  it  has  the  nice  property  that,  with  probability  1,  we  use 
all  of  our  spares.  This  is  not  the  case  with  any  other  model,  except 
for  the  parallel  model  in  which  we  had  the  option  of  forming  a  single 
group  containing  all  of  the  available  spares. 

One  ocher  possible  variation  of  this  model  would  be  to  limit  the 
maximum  number  of  spares  which  can  be  active  at  one  time.  In  the  Basic 
Model,  this  number  is  implicitly  assumed  to  be  one,  but  this  assumption 
could  be  modified.  For  example,  on  a  multiple  engine  aircraft,  it  is 
sensible  to  allow  some  finite  number  of  spares  greater  than  one  to  be 
active  at  one  time. 

Further  exploration  in  these  areas  would  have  the  effect  of  making 
the  Basic  Model  more  applicable  to  specific  applications.  Since  the 
Basic  Model,  and  especially  the  Minimax  Model,  were  developed  with  the 
objective  of  being  easy  to  implement,  it  is  hoped  that  any  extensions  or 
variations  would  also  pursue  this  objective. 
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